-- Logs begin at Wed 2022-02-16 04:54:00 UTC, end at Wed 2022-02-16 05:53:44 UTC. -- Feb 16 05:24:31.515273 dv-cinder-829473-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 16 05:24:31.523209 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 16 05:24:31.525251 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 05:24:31 2022] *** Feb 16 05:24:31.525251 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 05:24:31.525251 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 05:24:31.525251 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: nodename: dv-cinder-829473-2-iscsi Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: machine: x86_64 Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: clock source: unix Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: pcre jit disabled Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: detected number of CPU cores: 4 Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: current working directory: / Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: detected binary path: /usr/bin/uwsgi-core Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: your processes number limit is 47680 Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: your memory page size is 4096 bytes Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: detected max file descriptor number: 2048 Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: lock engine: pthread robust mutexes Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: thunder lock: enabled Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 16 05:24:31.529300 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 05:24:31.574746 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: Python main interpreter initialized at 0x564dcf5919c0 Feb 16 05:24:31.574746 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: python threads support enabled Feb 16 05:24:31.574746 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: your server socket listen backlog is limited to 100 connections Feb 16 05:24:31.574746 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: your mercy for graceful operations on workers is 90 seconds Feb 16 05:24:31.575148 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 05:24:31.575148 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: *** Operational MODE: preforking *** Feb 16 05:24:31.575420 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: *** uWSGI is running in multiple interpreter mode *** Feb 16 05:24:31.575420 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: spawned uWSGI master process (pid: 101828) Feb 16 05:24:31.575620 dv-cinder-829473-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 16 05:24:31.576255 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: spawned uWSGI worker 1 (pid: 101829, cores: 1) Feb 16 05:24:31.576591 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: spawned uWSGI worker 2 (pid: 101830, cores: 1) Feb 16 05:24:31.576750 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 05:24:33.419204 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:24:33.419204 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: from cryptography.utils import int_from_bytes Feb 16 05:24:33.419895 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:24:33.419895 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: from cryptography.utils import int_from_bytes Feb 16 05:24:33.425120 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:24:33.425120 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: from cryptography.utils import int_from_bytes Feb 16 05:24:33.425635 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:24:33.425635 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: from cryptography.utils import int_from_bytes Feb 16 05:24:36.037927 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:24:36.038460 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:24:36.038678 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:24:36.039036 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:24:36.039336 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:24:36.039676 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.040001 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.040322 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.040643 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.040981 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.041312 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.041633 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.041951 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.042365 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:24:36.042732 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.042732 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.042917 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:24:36.043003 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.043240 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829473-2-iscsi {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.043538 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:24:36.043624 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.043858 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.043940 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:24:36.044172 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.044493 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.044799 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.045123 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.045422 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:24:36.045523 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.045843 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.045959 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046338 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046484 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046593 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046705 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046843 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.046967 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047194 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047319 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047519 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047646 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047858 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.047987 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048190 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048316 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048499 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048635 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048771 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.048901 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049102 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049228 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049467 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829473-2-iscsi {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049616 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829473-2-iscsi {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049803 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.049933 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050122 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050263 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050436 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050567 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050765 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.050900 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051080 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051290 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051415 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051543 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051715 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.051843 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.052308 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.052487 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.052635 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.052855 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.052991 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.053175 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.053339 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.053596 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.053724 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.053916 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054042 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054222 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054361 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054532 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054671 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054843 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.054979 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055162 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055296 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055474 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055602 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055780 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.055915 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056038 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056283 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829473-2-iscsi {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056411 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056610 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056737 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.056933 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057061 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057267 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057411 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057537 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057706 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.057834 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058029 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058165 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058348 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058476 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058678 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058806 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.058987 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059121 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059298 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059432 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059608 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059734 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.059916 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060051 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060225 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060359 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060532 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060660 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060840 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.060972 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061157 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061317 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061499 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061633 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061823 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.061960 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062131 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062258 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062445 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062577 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062709 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.062832 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063010 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063137 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063342 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063470 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063678 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.063806 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064003 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064135 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064267 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064398 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064523 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064653 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064817 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.064945 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065147 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065303 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065500 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065630 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065821 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.065956 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066138 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066266 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066455 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066590 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066760 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.066891 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067027 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067151 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067301 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067439 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067608 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067736 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.067928 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.068057 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.068237 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.068867 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069068 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069205 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069382 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069508 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069688 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069815 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.069996 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070222 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070357 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070480 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070603 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070787 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.070923 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071135 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071264 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071463 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071589 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071773 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.071907 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072080 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072208 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072388 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072515 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072707 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.072834 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073022 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073149 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073351 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073478 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073663 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073790 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.073971 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074106 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074278 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074415 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074539 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074666 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.074921 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075050 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075239 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075365 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075562 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075689 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.075871 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076001 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076179 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076305 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076494 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076632 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076802 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.076934 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077110 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077237 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077450 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077656 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077788 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.077918 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078041 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078170 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078350 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078486 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078659 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078786 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.078967 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079094 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079273 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079413 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079578 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079705 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.079883 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080010 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080189 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080321 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080492 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080625 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080796 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.080923 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081099 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081228 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081433 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081555 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081756 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.081883 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082063 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082227 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082373 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082508 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082681 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.082807 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.083000 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.083135 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.083312 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.083448 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.083641 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.083780 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.084041 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.084704 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.084918 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.085083 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.085252 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.085434 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.085571 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.085695 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.085893 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.086019 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.086222 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.086358 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.086543 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.086674 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.086861 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.086988 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.087173 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.087313 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.087489 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.087616 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.087801 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.087929 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.088115 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.088252 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.088431 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.088558 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.088746 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.088872 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.089057 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.089185 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.089392 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.089519 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.089713 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.089841 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.090027 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.090155 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.090342 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.090474 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.090660 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.090787 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.090980 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.091107 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:24:36.091293 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.091427 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.091633 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.091762 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.091974 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092102 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092287 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092414 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092613 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092750 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.092933 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093068 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093246 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093422 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093579 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093707 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.093891 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094020 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094214 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094340 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094534 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094661 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094849 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.094991 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095166 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095293 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095484 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095624 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095798 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.095927 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096110 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096237 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096423 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096559 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096736 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.096863 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097070 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097197 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097406 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097546 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097724 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.097851 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098037 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098165 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098351 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098487 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098666 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098785 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.098980 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099116 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099293 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099447 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099582 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099817 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.099946 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100154 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100355 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100481 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100605 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100793 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.100921 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101114 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101250 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101459 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101585 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101766 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.101891 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102100 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102239 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102407 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102543 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102719 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.102846 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103032 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103160 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103344 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103475 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103650 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103784 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.103964 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104092 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104277 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104407 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104584 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104714 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.104908 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105037 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105222 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105409 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105541 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105678 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105869 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.105998 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106177 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106304 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106485 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106624 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106800 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.106928 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107111 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107238 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107422 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107557 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107733 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.107858 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108050 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108176 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108361 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108500 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108674 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.108803 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109007 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109133 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109347 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109490 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109694 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.109822 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110009 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110136 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110334 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110462 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110650 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110784 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.110958 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111077 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111270 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111404 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111573 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111707 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.111876 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112011 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112182 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112310 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112494 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112621 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112799 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.112928 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113104 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113232 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113413 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113537 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113721 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.113862 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114027 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114155 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114350 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114476 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114663 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114806 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.114967 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115094 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115297 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115425 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115604 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115740 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.115947 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116075 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116254 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116381 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116593 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116729 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.116927 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117055 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117240 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117386 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117585 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117719 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.117900 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118028 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118220 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118346 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118531 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118666 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118841 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.118969 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.119152 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.119278 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.119462 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.119588 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.119770 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120216 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120216 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120449 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120449 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120694 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120823 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.120947 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121078 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121191 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121358 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121485 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121608 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121731 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.121911 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122055 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122224 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122357 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122533 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122667 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122843 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.122980 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123156 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123284 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123489 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123614 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123803 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.123939 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124118 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124248 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124428 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124555 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124741 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.124877 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125053 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125187 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125391 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125531 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125713 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.125842 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126024 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126158 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126340 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126475 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126650 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126779 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.126972 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127106 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127283 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127412 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127600 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127728 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.127905 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128024 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128219 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128347 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128547 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128675 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128864 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.128997 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129178 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129428 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129558 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129681 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129825 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.129953 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.130137 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.130273 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.130446 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.130583 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.130758 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.131389 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.131596 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.131751 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.131905 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132034 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132216 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132344 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132533 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132675 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132843 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.132971 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133152 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133301 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133482 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133625 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133800 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.133930 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134108 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134236 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134412 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134561 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134721 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.134846 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135013 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135148 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135334 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135471 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135645 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135774 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.135972 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136099 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136293 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136422 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136598 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.136908 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.137228 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.137369 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.137560 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.137690 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.137868 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138027 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138174 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138348 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138479 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138666 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138823 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.138988 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139126 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139312 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139440 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139629 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139754 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.139944 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140080 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140265 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140391 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140592 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140717 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.140913 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141050 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141221 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141371 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141561 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141699 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.141874 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142001 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142187 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142321 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142498 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142626 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142808 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.142937 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143118 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143246 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143428 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143557 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143749 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.143877 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144057 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144193 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144368 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144495 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144678 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144806 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.144981 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145109 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145307 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145451 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145627 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145756 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.145954 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.146195 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.146323 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147100 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147233 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147427 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147557 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147750 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.147877 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148071 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148215 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148390 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148518 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148721 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.148849 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149042 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149169 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149378 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149506 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149710 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.149854 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150021 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150163 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150329 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150459 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150633 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150760 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.150945 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151083 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151252 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151387 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151556 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151684 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151861 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.151989 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152170 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152298 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152475 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152604 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152779 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.152908 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153081 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153210 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153411 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153539 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153728 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.153857 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154032 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154159 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154343 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154470 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154648 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.154924 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155052 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155269 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155396 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155572 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155701 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.155880 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156008 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156184 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156320 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156525 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156662 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156829 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.156963 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157163 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157305 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157512 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157640 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157846 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.157976 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158152 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158294 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158458 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158599 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158769 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.158903 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159073 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159207 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159376 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159512 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159679 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159814 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.159988 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160115 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160295 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160423 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160598 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.160909 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161042 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161215 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161398 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161549 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161680 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161859 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.161987 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162185 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162314 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162499 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162635 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162804 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.162933 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163117 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163253 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163423 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163550 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163727 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.163863 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164030 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164159 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164340 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164466 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164647 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164786 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.164952 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165079 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165279 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165409 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165588 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165729 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.165909 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166037 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166212 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166351 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166518 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166656 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166820 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.166950 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167127 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167255 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167436 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167565 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167738 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.167873 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168059 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168187 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168367 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168509 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168672 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168807 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.168975 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169103 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169313 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169445 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169620 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169747 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.169925 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170064 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170237 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170368 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170559 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170695 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.170876 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171014 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171181 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171309 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171491 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171619 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171797 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.171933 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172101 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172229 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172406 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172534 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172715 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.172852 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173020 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173147 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173360 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173500 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173678 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173815 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.173989 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174124 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174294 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174423 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174604 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174732 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.174917 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175045 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175222 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175349 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175528 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175658 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175836 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.175963 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176164 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176290 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176469 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176596 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176781 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.176907 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.177368 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.177502 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.177690 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.177820 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178039 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178175 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178351 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178486 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178664 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178794 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.178978 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179106 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179282 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179419 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179599 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.179911 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180039 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180221 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180360 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180525 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180651 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180833 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.180961 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181148 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181314 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181482 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181608 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181790 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.181917 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182102 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182231 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182414 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182542 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182725 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.182853 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183028 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183156 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183339 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183467 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183650 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183785 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.183988 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184122 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184253 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184382 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184555 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184703 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184865 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.184995 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185176 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185322 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185508 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185649 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185824 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.185952 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186136 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186264 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186443 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186580 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186755 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.186885 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187065 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187195 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187370 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187507 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187694 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.187829 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188003 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188130 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188307 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188443 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188616 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188766 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.188921 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189050 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189231 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189422 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189548 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189671 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.189889 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190023 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190221 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190358 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190552 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190680 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190855 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.190989 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191166 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191295 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191479 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191606 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191794 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.191922 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192109 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192238 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192413 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192543 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192730 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.192885 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.193051 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.193187 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.193981 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194113 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194296 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194433 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194602 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194738 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.194906 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195041 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195218 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195354 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195541 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195674 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195845 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.195974 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196150 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196286 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196459 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196589 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196779 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.196909 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197082 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197218 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197425 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197566 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197746 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.197872 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198070 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198200 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198387 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198514 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198823 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.198951 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199135 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199271 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199445 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199572 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199757 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.199890 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200076 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200209 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200395 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200521 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200700 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.200828 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201015 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201144 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201347 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201489 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201673 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201809 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.201997 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202125 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202309 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202437 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202623 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202764 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.202929 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203056 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203249 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203377 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203570 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203706 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.203886 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204021 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204207 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204334 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204518 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204653 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204831 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.204961 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205161 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205317 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205501 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205651 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205836 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.205978 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206160 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206294 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206473 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206601 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206786 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.206916 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207092 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207275 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207411 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207597 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207734 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.207917 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208045 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208247 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208377 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208577 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208713 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.208886 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.209076 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.209747 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.209885 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210054 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210201 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210378 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210506 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210684 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.210820 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211007 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211144 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211324 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211453 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211648 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211785 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.211972 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212101 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212281 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212420 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212607 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212735 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.212920 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213056 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213226 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213393 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213553 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213681 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213860 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.213990 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214203 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214339 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214508 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214646 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214831 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.214959 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215161 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215289 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215488 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215634 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215802 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.215929 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216136 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216264 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216446 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216583 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216768 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.216903 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217082 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217207 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217425 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217567 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217733 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.217854 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218040 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218175 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218352 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218480 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218655 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218789 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.218960 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219088 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219265 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219394 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219574 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219704 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.219878 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220007 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220198 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220356 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220483 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220614 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220794 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.220923 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221099 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221235 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221444 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221573 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221757 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.221897 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222064 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222193 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222369 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222503 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222673 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.222816 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223013 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223149 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223316 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223452 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223647 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223783 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.223963 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224090 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224283 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224410 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224625 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224803 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.224939 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225071 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225251 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225395 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225591 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225720 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.225909 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226038 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226227 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226354 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226546 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226674 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226860 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.226989 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227174 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227301 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227486 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227613 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227795 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.227921 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228111 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228239 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228423 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228550 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228736 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.228864 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229051 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229244 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229406 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229594 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229725 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.229909 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230041 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230223 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230360 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230534 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230663 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230846 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.230975 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231159 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231290 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231470 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231597 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231779 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.231950 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232077 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232201 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232390 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232510 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232716 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.232852 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233035 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233165 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233381 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233511 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233714 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.233856 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234027 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234156 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234340 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234469 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234660 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234809 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.234935 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235058 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235290 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235424 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235605 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235741 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.235910 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236038 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236222 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236351 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236542 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236671 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236856 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.236984 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.237166 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.237324 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.237499 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.237758 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.237886 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238098 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238232 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238428 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238567 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238717 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.238853 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239029 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239151 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239342 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239472 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239662 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239795 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.239985 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240113 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240324 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240453 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240638 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240774 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.240949 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241092 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241282 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241413 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241621 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241798 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.241957 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242102 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242300 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242429 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242625 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242755 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.242949 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243089 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243271 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243400 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243593 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243721 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.243961 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244093 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244266 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244400 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244571 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244708 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.244883 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245012 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245193 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245349 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245532 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245673 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245854 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.245991 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246165 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246293 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246475 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246615 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246792 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.246920 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247099 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247225 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247420 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247626 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247756 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.247968 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248099 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248284 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248413 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248613 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248742 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.248937 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249078 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249252 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249440 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249575 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249700 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.249896 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250024 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250204 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250476 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250616 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250832 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.250967 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251093 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251216 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251398 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251534 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251700 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.251828 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252011 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252140 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252320 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252449 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252624 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252744 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.252933 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253073 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253236 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253383 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253586 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253722 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.253892 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254203 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254348 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254475 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254601 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.254867 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255008 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255135 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255258 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255384 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255517 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255643 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.255799 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.256489 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.256806 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.256941 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257108 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257246 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257442 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257585 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257746 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.257876 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258054 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258192 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258356 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258521 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258650 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258838 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.258973 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259171 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259301 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259487 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259617 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259806 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.259943 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260131 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260269 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260453 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260591 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260770 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.260909 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261086 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261215 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261418 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261546 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261744 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.261948 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262077 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262209 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262369 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262588 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262719 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.262930 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263066 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263256 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263386 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263597 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263820 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.263941 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264065 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264213 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264354 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264527 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264665 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264834 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.264962 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265146 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265312 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265486 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265633 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265799 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.265927 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266110 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266243 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266420 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266556 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266734 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.266864 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267050 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267178 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267361 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267497 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267674 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267804 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.267983 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268119 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268293 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268424 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268605 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268734 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.268923 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269053 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269250 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269406 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269595 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.269915 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270052 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270235 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270366 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270552 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270689 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.270862 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.271031 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.271163 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.271366 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.271532 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.272306 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.272493 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.272637 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.272838 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.272968 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.273170 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.273346 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.273542 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.273684 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.273887 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274028 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274206 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274337 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274524 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274653 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274840 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.274969 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275174 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275306 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275500 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275630 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275825 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.275954 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276147 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276278 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276466 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276595 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276784 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.276913 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277104 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277248 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277453 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277583 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277778 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.277907 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278101 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278242 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278405 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278532 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278714 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.278853 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279020 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279157 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279332 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279463 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279661 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279790 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.279994 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280128 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280312 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280440 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280635 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280769 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.280945 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281073 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281302 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281452 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281581 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281704 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.281902 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282033 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282225 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282362 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282538 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282666 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282850 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.282986 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283173 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283300 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283484 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283621 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283798 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.283926 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284109 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284238 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284422 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284559 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284733 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.284861 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285045 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285174 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285397 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285544 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285722 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.285860 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286028 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286158 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286351 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286488 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286666 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286797 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.286990 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.287138 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.287365 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.287504 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.287681 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.287811 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288051 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288188 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288322 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288457 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288624 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288754 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.288935 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289079 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289245 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289399 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289584 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289713 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.289903 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290045 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290226 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290355 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290552 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290688 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.290877 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291015 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291203 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291351 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291630 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291758 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.291944 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292086 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292288 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292426 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292609 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292736 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.292923 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293051 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293237 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293390 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293563 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293691 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.293828 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:24:36.293955 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.294210 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.294532 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.294928 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.295275 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.295613 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.295929 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.296314 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.296650 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.296978 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.297324 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.297651 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.297992 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.298315 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.298642 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.298964 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.299287 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.299615 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.301473 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.303886 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.304255 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.304618 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.304977 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.305379 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.305726 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.306156 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.306507 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.306845 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.307179 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.307503 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:24:36.307763 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:24:36.316391 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.330122 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_db.sqlalchemy.engines [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.380649 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.context [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b177d00-4ec8-4b1e-aaf9-b063453fd96c(cell1) {{(pid=101829) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 05:24:36.384916 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:24:36.386545 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:24:36.387353 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:24:36.389309 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:24:36.393531 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.context [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b177d00-4ec8-4b1e-aaf9-b063453fd96c(cell1) {{(pid=101830) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 05:24:36.397895 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_concurrency.lockutils [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:24:36.399529 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_concurrency.lockutils [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:24:36.399852 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.400365 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_concurrency.lockutils [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:24:36.402382 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_concurrency.lockutils [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:24:36.402637 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.414939 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_db.sqlalchemy.engines [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.417856 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_db.sqlalchemy.engines [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.563730 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_db.sqlalchemy.engines [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:36.577314 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG oslo_db.sqlalchemy.engines [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:24:37.024423 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: WARNING keystonemiddleware.auth_token [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:24:37.026071 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: WARNING keystonemiddleware.auth_token [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:24:37.031026 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: WARNING keystonemiddleware.auth_token [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:24:37.032766 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: WARNING keystonemiddleware.auth_token [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:24:37.253381 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: WARNING keystonemiddleware.auth_token [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:24:37.258128 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: WARNING keystonemiddleware.auth_token [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:24:37.259272 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: WARNING keystonemiddleware.auth_token [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:24:37.263262 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: WARNING keystonemiddleware.auth_token [None req-e7ea3258-53e8-4ad5-a19d-211f999d762c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:24:37.264435 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564dcf5919c0 pid: 101830 (default app) Feb 16 05:24:37.266523 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:24:37.267682 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Feb 16 05:24:37.268092 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Wed Feb 16 05:24:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:24:37.268593 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564dcf5919c0 pid: 101829 (default app) Feb 16 05:25:58.438000 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:25:58.438989 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 16 05:25:58.439394 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:25:58.883965 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ad7e3191-7e03-475d-b9a1-3940404eac3b admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:25:58.913490 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ad7e3191-7e03-475d-b9a1-3940404eac3b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.467182 Feb 16 05:25:58.914150 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Wed Feb 16 05:25:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:26:01.265802 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:01.266794 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-4235510e-3982-4474-88ba-a69efde07bdf None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 16 05:26:01.267189 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:01.327645 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-0f741d08-d247-4302-bbfc-b3ba69a767c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "vcpus": 1}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:01.345698 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:26:01.345698 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:26:01.375254 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-0f741d08-d247-4302-bbfc-b3ba69a767c2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101993 Feb 16 05:26:01.376965 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:01.596013 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-61e8db5f-eeae-41aa-9522-5bfba66012a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:01.599007 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:26:01.599007 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: warnings.warn(msg) Feb 16 05:26:01.648578 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-61e8db5f-eeae-41aa-9522-5bfba66012a2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.264107 Feb 16 05:26:01.661600 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Wed Feb 16 05:26:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:03.959899 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-0f741d08-d247-4302-bbfc-b3ba69a767c2 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:03.960903 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-0f741d08-d247-4302-bbfc-b3ba69a767c2 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 16 05:26:03.961340 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:04.070675 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-fb3c8938-2b83-46d3-bf78-3517cf36cc52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:04.088893 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:26:04.088893 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: warnings.warn(msg) Feb 16 05:26:04.108961 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-fb3c8938-2b83-46d3-bf78-3517cf36cc52 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141903 Feb 16 05:26:04.109691 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:04.122475 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ceac1925-e2d0-4c7f-ab92-5466dbebb815 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:04.124491 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:26:04.124491 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:26:04.159133 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ceac1925-e2d0-4c7f-ab92-5466dbebb815 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041239 Feb 16 05:26:04.159925 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Wed Feb 16 05:26:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:06.534597 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-fb3c8938-2b83-46d3-bf78-3517cf36cc52 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:06.535610 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-fb3c8938-2b83-46d3-bf78-3517cf36cc52 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Feb 16 05:26:06.536230 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:06.599118 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-689214e0-b14b-496b-b370-bb735f82b487 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:06.618000 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-689214e0-b14b-496b-b370-bb735f82b487 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075341 Feb 16 05:26:06.618696 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:06.630951 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-a80c5a3f-0e49-42fd-85b2-d716ae95c431 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:06.657764 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-a80c5a3f-0e49-42fd-85b2-d716ae95c431 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030809 Feb 16 05:26:06.659927 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Wed Feb 16 05:26:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:26:08.984899 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-689214e0-b14b-496b-b370-bb735f82b487 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:08.985981 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-689214e0-b14b-496b-b370-bb735f82b487 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Feb 16 05:26:08.986388 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:09.045275 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-e94b89b5-eecb-4452-a60f-c41a20b7f1f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:09.067444 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-e94b89b5-eecb-4452-a60f-c41a20b7f1f5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074567 Feb 16 05:26:09.068243 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:26:09.080244 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ef4eb894-29cd-40ef-ae11-687037d5f082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:09.105024 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ef4eb894-29cd-40ef-ae11-687037d5f082 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029064 Feb 16 05:26:09.105965 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Wed Feb 16 05:26:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:26:11.455859 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-e94b89b5-eecb-4452-a60f-c41a20b7f1f5 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:11.456864 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-e94b89b5-eecb-4452-a60f-c41a20b7f1f5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Feb 16 05:26:11.457293 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:11.514405 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:11.532316 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069127 Feb 16 05:26:11.533073 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:11.544797 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-29433269-b005-4f93-80b4-f46049ef61e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:11.567168 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-29433269-b005-4f93-80b4-f46049ef61e6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025902 Feb 16 05:26:11.567886 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Wed Feb 16 05:26:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:13.981680 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:13.982695 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Feb 16 05:26:13.983100 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:14.040024 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-fc994487-3397-41a6-806d-391a5195f65c admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:14.063551 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-fc994487-3397-41a6-806d-391a5195f65c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074038 Feb 16 05:26:14.064379 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Wed Feb 16 05:26:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:16.507592 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:16.508611 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-aa409b3d-6a1f-44ac-8fed-70e5f8864463 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Feb 16 05:26:16.509039 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:16.568501 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-10ceef6f-598f-4664-be43-9583c734ab74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:16.590692 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-10ceef6f-598f-4664-be43-9583c734ab74 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075533 Feb 16 05:26:16.591411 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:16.603807 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-1fc914bd-9caf-4eeb-8b49-796eda16fa72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:16.628323 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-1fc914bd-9caf-4eeb-8b49-796eda16fa72 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028198 Feb 16 05:26:16.628910 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Wed Feb 16 05:26:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:26:19.553327 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-10ceef6f-598f-4664-be43-9583c734ab74 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:19.554396 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-10ceef6f-598f-4664-be43-9583c734ab74 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Feb 16 05:26:19.554819 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:19.614307 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-d3fb6a0d-6d51-49b9-9862-29350c8063a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:19.634200 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-d3fb6a0d-6d51-49b9-9862-29350c8063a0 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073417 Feb 16 05:26:19.635133 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:19.647284 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-0a834f37-f170-4630-b6e1-5bb51f06dd6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:19.670586 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-0a834f37-f170-4630-b6e1-5bb51f06dd6b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027770 Feb 16 05:26:19.671179 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Wed Feb 16 05:26:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:22.051587 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-d3fb6a0d-6d51-49b9-9862-29350c8063a0 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:22.052590 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-d3fb6a0d-6d51-49b9-9862-29350c8063a0 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 16 05:26:22.053001 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:22.110440 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-09e92dd3-e40a-4134-a073-1785a6dae212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:22.128733 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-09e92dd3-e40a-4134-a073-1785a6dae212 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069936 Feb 16 05:26:22.129316 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:22.140918 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-be4b3ee4-f451-4935-aa4d-56bc040a5731 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:22.163461 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-be4b3ee4-f451-4935-aa4d-56bc040a5731 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026199 Feb 16 05:26:22.164024 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Wed Feb 16 05:26:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:24.556190 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-09e92dd3-e40a-4134-a073-1785a6dae212 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:24.557836 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-09e92dd3-e40a-4134-a073-1785a6dae212 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Feb 16 05:26:24.562961 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:24.621576 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-9af8743c-a764-496e-83a8-3dd856286ebb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:24.640295 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-9af8743c-a764-496e-83a8-3dd856286ebb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076276 Feb 16 05:26:24.640856 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:26:24.653739 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-57ea75f3-7a2b-447a-b89d-e2f746c7d7b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:24.680541 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-57ea75f3-7a2b-447a-b89d-e2f746c7d7b1 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030950 Feb 16 05:26:24.681125 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Wed Feb 16 05:26:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:27.068253 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-9af8743c-a764-496e-83a8-3dd856286ebb admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:27.069941 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-9af8743c-a764-496e-83a8-3dd856286ebb admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Feb 16 05:26:27.070536 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:26:27.137129 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "swap": 0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:27.156682 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080129 Feb 16 05:26:27.157473 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Wed Feb 16 05:26:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:27.169182 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-3d9b0142-0ca9-4237-9d9a-e551f5760a93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:27.198148 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-3d9b0142-0ca9-4237-9d9a-e551f5760a93 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032705 Feb 16 05:26:27.209866 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Wed Feb 16 05:26:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:26:49.207049 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:49.208046 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Feb 16 05:26:49.208445 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:49.264536 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-a950bd31-52de-4046-ae69-79b033af7228 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:49.280871 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-a950bd31-52de-4046-ae69-79b033af7228 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066594 Feb 16 05:26:49.281434 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Wed Feb 16 05:26:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:50.645000 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:50.646033 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-6e0790e1-e0af-46d9-8bcb-e2f56d4b97c6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Feb 16 05:26:50.646459 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:50.877809 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-8316bbae-8932-4e34-a32b-d9a7699f69bd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:50.883252 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.wsgi [None req-8316bbae-8932-4e34-a32b-d9a7699f69bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 16 05:26:50.883818 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-8316bbae-8932-4e34-a32b-d9a7699f69bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:50.884609 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-8316bbae-8932-4e34-a32b-d9a7699f69bd admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060156 Feb 16 05:26:50.885123 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Feb 16 05:26:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:50.894926 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-df62cddf-116c-4bbd-98f8-fc797ec5965c admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:50.915475 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-df62cddf-116c-4bbd-98f8-fc797ec5965c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024580 Feb 16 05:26:50.915997 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:50.926094 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-5981bd98-6012-434a-8872-ffb5a3f98da6 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:50.947227 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-5981bd98-6012-434a-8872-ffb5a3f98da6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025373 Feb 16 05:26:50.947762 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:50.956776 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-01532bce-273d-47a3-a3df-7936a76023b2 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:50.962129 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.wsgi [None req-01532bce-273d-47a3-a3df-7936a76023b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 16 05:26:50.962694 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-01532bce-273d-47a3-a3df-7936a76023b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:50.963476 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-01532bce-273d-47a3-a3df-7936a76023b2 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010233 Feb 16 05:26:50.963967 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Feb 16 05:26:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:52.271545 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-5981bd98-6012-434a-8872-ffb5a3f98da6 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:52.272543 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-5981bd98-6012-434a-8872-ffb5a3f98da6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Feb 16 05:26:52.272950 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:52.460644 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-029b3e16-21ef-4278-ad5d-20e0354e6b1d admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:52.465809 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.wsgi [None req-029b3e16-21ef-4278-ad5d-20e0354e6b1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 16 05:26:52.466367 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-029b3e16-21ef-4278-ad5d-20e0354e6b1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:52.467169 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-029b3e16-21ef-4278-ad5d-20e0354e6b1d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057211 Feb 16 05:26:52.467675 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Feb 16 05:26:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:52.476858 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-a422ebac-c191-4bda-8cfd-39761b4491d2 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:52.490422 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-a422ebac-c191-4bda-8cfd-39761b4491d2 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017012 Feb 16 05:26:52.490866 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:26:52.499757 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-51c0cbe2-0b6e-433d-8615-51a5d4a159c3 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:52.513545 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-51c0cbe2-0b6e-433d-8615-51a5d4a159c3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017146 Feb 16 05:26:52.514256 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:52.522729 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-910f9345-a713-4567-aec8-c49cd47da6d8 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:52.527717 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.wsgi [None req-910f9345-a713-4567-aec8-c49cd47da6d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 16 05:26:52.528264 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-910f9345-a713-4567-aec8-c49cd47da6d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:52.529056 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-910f9345-a713-4567-aec8-c49cd47da6d8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009671 Feb 16 05:26:52.529562 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Feb 16 05:26:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:53.787247 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-51c0cbe2-0b6e-433d-8615-51a5d4a159c3 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:53.788275 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-51c0cbe2-0b6e-433d-8615-51a5d4a159c3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Feb 16 05:26:53.788677 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:53.976528 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-3568acf8-bf0a-4047-b1ce-5a28d1813498 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:53.981766 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.wsgi [None req-3568acf8-bf0a-4047-b1ce-5a28d1813498 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 16 05:26:53.982313 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-3568acf8-bf0a-4047-b1ce-5a28d1813498 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:53.983107 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-3568acf8-bf0a-4047-b1ce-5a28d1813498 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056897 Feb 16 05:26:53.983600 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:26:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 16 05:26:53.993231 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-a01d4aac-64b4-400d-8ff8-6b66c74150b2 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:54.007015 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-a01d4aac-64b4-400d-8ff8-6b66c74150b2 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017237 Feb 16 05:26:54.007532 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:26:54.016548 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:54.029500 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016563 Feb 16 05:26:54.030018 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Feb 16 05:26:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:26:54.038700 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4a5713ad-b9d3-4ed3-b848-d64d23113072 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:54.043812 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.wsgi [None req-4a5713ad-b9d3-4ed3-b848-d64d23113072 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 16 05:26:54.044397 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4a5713ad-b9d3-4ed3-b848-d64d23113072 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:26:54.045169 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-4a5713ad-b9d3-4ed3-b848-d64d23113072 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009855 Feb 16 05:26:54.045687 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:26:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 16 05:26:55.298301 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:55.299403 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Feb 16 05:26:55.299802 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:55.486358 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-62b2cfc4-dfbd-4e30-ad0a-749aabbbd8f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:55.503515 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-62b2cfc4-dfbd-4e30-ad0a-749aabbbd8f2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067924 Feb 16 05:26:55.504039 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Feb 16 05:26:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:56.760222 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:56.761248 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Feb 16 05:26:56.761671 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:26:56.951264 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-f4c1710c-9fe1-4f5b-99ea-b4880db89ccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:56.970047 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-f4c1710c-9fe1-4f5b-99ea-b4880db89ccb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069311 Feb 16 05:26:56.971241 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Feb 16 05:26:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:26:58.228998 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:58.230024 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Feb 16 05:26:58.230424 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:26:58.423844 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-4b4ce07e-6756-4f92-a705-853b84818c74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:26:58.443475 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-4b4ce07e-6756-4f92-a705-853b84818c74 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075342 Feb 16 05:26:58.444025 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Feb 16 05:26:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:26:59.902115 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:26:59.903102 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Feb 16 05:26:59.903489 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:27:00.098442 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-d10b628d-c687-44e7-a3f9-25f224a105b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:27:00.116053 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-d10b628d-c687-44e7-a3f9-25f224a105b5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074436 Feb 16 05:27:00.116596 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Feb 16 05:27:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:27:01.378125 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:01.379119 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Feb 16 05:27:01.379522 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:27:01.573599 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-3405e455-12a8-48db-b8eb-d593a8b9858b admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:01.592126 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-3405e455-12a8-48db-b8eb-d593a8b9858b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068930 Feb 16 05:27:01.592586 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Wed Feb 16 05:27:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:27:51.851525 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:51.852555 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-ff5e7652-ff6d-49d9-90c5-06e104bb97fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 16 05:27:51.852956 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Wed Feb 16 05:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:27:51.908987 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-1a59f7e8-52e1-448a-ac1b-b0d96e4a9b62 admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:51.929107 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-1a59f7e8-52e1-448a-ac1b-b0d96e4a9b62 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070503 Feb 16 05:27:51.929669 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Wed Feb 16 05:27:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:27:51.951519 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-9807c9a8-a0bc-43ff-9097-422c7d779cce admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:51.959837 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-9807c9a8-a0bc-43ff-9097-422c7d779cce admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011992 Feb 16 05:27:51.960353 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Wed Feb 16 05:27:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:27:51.971313 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-0b778c15-6c1d-4b20-96d3-9cf2ea3d6cee admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:51.978757 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-0b778c15-6c1d-4b20-96d3-9cf2ea3d6cee admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010948 Feb 16 05:27:51.979259 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Wed Feb 16 05:27:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:27:51.989629 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-9bfe4ce2-3a84-4a19-992e-39c77372f8bb admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:51.996848 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-9bfe4ce2-3a84-4a19-992e-39c77372f8bb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010573 Feb 16 05:27:51.997383 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Wed Feb 16 05:27:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:27:52.008166 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:27:52.015521 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010647 Feb 16 05:27:52.016682 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Wed Feb 16 05:27:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:29:29.926562 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-b81fba3a-e4c4-402b-ade9-ac8db7ca8a74 tempest-verify_tempest_config-32479049 tempest-verify_tempest_config-32479049-project] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:29:29.928532 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-b81fba3a-e4c4-402b-ade9-ac8db7ca8a74 tempest-verify_tempest_config-32479049 tempest-verify_tempest_config-32479049-project] 10.222.0.75 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103786 Feb 16 05:29:29.929066 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 34/69] 10.222.0.75 () {58 vars in 1133 bytes} [Wed Feb 16 05:29:29 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:31:06.496191 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:06.497216 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Feb 16 05:31:06.497633 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 36/70] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:31:06.750912 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:06.752149 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:31:06.752149 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:31:06.753854 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:06.754394 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:06.755281 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:06.755817 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:06.788350 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-1cdc778e-c1a1-45d7-9e26-27df685c93d5 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153033 Feb 16 05:31:06.788912 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 35/71] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:31:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:31:08.128578 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:08.129602 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 16 05:31:08.130033 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 37/72] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:31:08.324930 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:08.326131 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:31:08.326131 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:31:08.327638 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:08.328138 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:08.328928 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:08.329386 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:08.349275 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-d9f9a0f5-7c57-4311-8470-6fc8e4ccf8dd admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076634 Feb 16 05:31:08.349771 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 36/73] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:31:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:31:20.044252 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:20.045245 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Feb 16 05:31:20.045661 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 38/74] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:31:20.233418 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:20.234577 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:31:20.234577 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:31:20.236107 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:20.236551 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:20.237375 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:20.237807 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:20.261973 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-86133f90-d4ab-46fe-a52c-8ecf60221802 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078196 Feb 16 05:31:20.262456 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 37/75] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:31:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:31:21.611380 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: DEBUG nova.api.openstack.wsgi [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] Calling method '>' {{(pid=101830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:21.612376 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: INFO nova.api.openstack.requestlog [None req-18ecc9ab-e7f1-402b-960b-afc59fdddebf admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Feb 16 05:31:21.612770 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: [pid: 101830|app: 0|req: 39/76] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Feb 16 05:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:31:21.804280 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG nova.api.openstack.wsgi [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] Calling method '>' {{(pid=101829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:31:21.805461 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:31:21.805461 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: warnings.warn(msg) Feb 16 05:31:21.806961 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:21.807428 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:21.808225 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:31:21.808645 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: DEBUG oslo_concurrency.lockutils [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:31:21.829138 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: INFO nova.api.openstack.requestlog [None req-70d31231-ada0-4838-84da-609c125c2b6d admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075653 Feb 16 05:31:21.829664 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: [pid: 101829|app: 0|req: 38/77] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Feb 16 05:31:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:32:18.436984 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: Wed Feb 16 05:32:18 2022 - graceful shutdown triggered... Feb 16 05:32:18.437114 dv-cinder-829473-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 16 05:32:18.438105 dv-cinder-829473-2-iscsi devstack@n-api.service[101830]: Gracefully killing worker 2 (pid: 101830)... Feb 16 05:32:18.438488 dv-cinder-829473-2-iscsi devstack@n-api.service[101829]: Gracefully killing worker 1 (pid: 101829)... Feb 16 05:32:19.439170 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: worker 1 buried after 1 seconds Feb 16 05:32:19.439170 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: worker 2 buried after 1 seconds Feb 16 05:32:19.439170 dv-cinder-829473-2-iscsi devstack@n-api.service[101828]: goodbye to uWSGI. Feb 16 05:32:19.440641 dv-cinder-829473-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 16 05:32:19.441208 dv-cinder-829473-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 16 05:32:19.443913 dv-cinder-829473-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 16 05:32:19.464255 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 05:32:19 2022] *** Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: nodename: dv-cinder-829473-2-iscsi Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: machine: x86_64 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: clock source: unix Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: pcre jit disabled Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: detected number of CPU cores: 4 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: current working directory: / Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: detected binary path: /usr/bin/uwsgi-core Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: your processes number limit is 47680 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: your memory page size is 4096 bytes Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: detected max file descriptor number: 2048 Feb 16 05:32:19.490502 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: lock engine: pthread robust mutexes Feb 16 05:32:19.491621 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: thunder lock: enabled Feb 16 05:32:19.491621 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 16 05:32:19.491621 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 05:32:19.537308 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: Python main interpreter initialized at 0x556e7647c9c0 Feb 16 05:32:19.537308 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: python threads support enabled Feb 16 05:32:19.537308 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: your server socket listen backlog is limited to 100 connections Feb 16 05:32:19.537308 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: your mercy for graceful operations on workers is 90 seconds Feb 16 05:32:19.537671 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 05:32:19.537751 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: *** Operational MODE: preforking *** Feb 16 05:32:19.537974 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: *** uWSGI is running in multiple interpreter mode *** Feb 16 05:32:19.537974 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: spawned uWSGI master process (pid: 122862) Feb 16 05:32:19.538173 dv-cinder-829473-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 16 05:32:19.539055 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: spawned uWSGI worker 1 (pid: 122878, cores: 1) Feb 16 05:32:19.539180 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: spawned uWSGI worker 2 (pid: 122879, cores: 1) Feb 16 05:32:19.539271 dv-cinder-829473-2-iscsi devstack@n-api.service[122862]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 05:32:21.459481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:32:21.459481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: from cryptography.utils import int_from_bytes Feb 16 05:32:21.460197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:32:21.460197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: from cryptography.utils import int_from_bytes Feb 16 05:32:21.460657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:32:21.460657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: from cryptography.utils import int_from_bytes Feb 16 05:32:21.460784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:32:21.460784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: from cryptography.utils import int_from_bytes Feb 16 05:32:23.947613 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:32:23.948229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:32:23.948229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:32:23.948688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:32:23.948874 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:32:23.949241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.949595 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.949922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.950244 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.950586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.950903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.951230 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.951554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.951886 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.952150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.952471 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.952831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829473-2-iscsi {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.953160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.953496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.953817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.954148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.954445 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.954770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.955080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.955592 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957603 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.957929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.958245 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.958559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.958869 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.959175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.959591 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829473-2-iscsi {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.959886 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:32:23.960412 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.960623 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:32:23.960845 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.960845 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.961301 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:32:23.961543 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.961764 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:32:23.961972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.962190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:32:23.962411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.962632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.962852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963282 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963494 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963834 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.963982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964164 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964630 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.964984 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965309 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.965940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-829473-2-iscsi {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.966879 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967330 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.967917 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.968076 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.968751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.968978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.969141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.970677 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.970677 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.971992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972142 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.972893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973044 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.973980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974574 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-829473-2-iscsi {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974730 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.974882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975025 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975330 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975624 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.975919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976245 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.976856 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977013 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977164 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977369 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977682 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.977993 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978143 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978739 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.978894 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.979050 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.979201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.979344 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.979992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.980161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.980307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.980459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.980824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.980985 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981610 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.981916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982236 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.982882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983187 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.983789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.984493 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.984666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.984811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.984962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985515 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985670 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.985970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.986119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.986347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.986501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.986656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.987344 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.987496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.987641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.987793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.987951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988395 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.988997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.989150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.989364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.989364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.990146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.990146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.990468 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.990621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.990909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.991191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.991530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.991692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.991855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992006 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992159 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992159 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992583 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.992876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993635 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.993956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.994997 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.995148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.995293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.995448 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.995604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.995759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996663 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.996973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997601 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997747 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.997900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998051 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998202 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998506 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:23.998948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.998948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.999235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:23.999379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:23.999522 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:23.999664 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.000308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.000475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.001217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.001365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.001460 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.001562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.001657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.001750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.001851 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.001937 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.002028 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.002113 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.002270 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.002423 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.002511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.002602 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.002696 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.002788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.002873 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.002965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003051 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.003144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003243 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.003336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.003518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003609 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.003701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003799 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.003884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.003968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004050 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004133 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004222 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004325 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004691 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.004970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.004970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.005138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.005231 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.005534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.005654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.005767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.005879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.006000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.006114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.006312 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.006405 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.006497 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.006582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.006676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.006862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.006967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.007054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.007146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.007238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.007322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.007424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.007524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.007619 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.007715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.007808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:32:24.007907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008281 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008372 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008654 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008747 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.008931 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009023 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.009975 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010510 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010600 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.010952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011222 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011318 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.011932 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012458 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012640 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012724 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012909 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.012993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013423 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013553 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013764 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.013858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014085 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014404 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014721 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.014818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015030 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015694 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.015793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016102 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016643 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.016957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.017959 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018389 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018709 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.018908 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019017 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019333 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.019998 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.020170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.020423 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.020643 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.020783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.020933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.021072 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.021208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.021399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.021739 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.021884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022318 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022470 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.022928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023212 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023352 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023792 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.023940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024247 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024853 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.024994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025584 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025672 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025756 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.025933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026354 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026890 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.026982 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.027205 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.027298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.027532 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.027684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.027871 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.028014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.028162 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.028293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.028486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.028801 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.029126 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.029421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.029587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.029741 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.029896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.030041 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.030191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.030337 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.030582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.031335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.031502 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.031675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032009 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032009 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032284 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032506 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032685 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.032979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.033335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.033670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.033810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034036 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034764 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.034891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.035032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.035339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.035573 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.035669 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.035913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036043 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036573 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.036907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037009 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037690 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.037900 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038215 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038316 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038863 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.038974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.039972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040154 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.040952 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041251 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041456 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041758 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.041919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042686 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.042989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043132 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043773 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.043924 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.044868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045322 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045501 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.045947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.046112 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.046256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.047036 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.047183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.047607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.047759 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.047938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048266 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.048859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049008 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.049823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050720 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.050859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051051 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051153 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.051788 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052024 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.052997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053225 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053659 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053886 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.053989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054195 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054829 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.054923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055462 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055555 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055772 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.055864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056512 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056719 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.056813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057028 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057677 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.057770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058262 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.058981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059528 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.059935 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060809 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.060948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061653 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.061890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062267 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.062980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063643 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.063952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064258 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064351 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064872 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.064967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065305 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065618 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.065934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066565 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066783 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.066877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067494 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067698 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.067799 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068104 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068447 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.068974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069317 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.069940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070258 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.070925 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071168 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071618 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.071890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072103 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072717 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.072904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073028 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073244 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.073946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074048 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.074972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.075178 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.075278 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.075488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.075803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076057 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076157 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076381 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.076997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.077995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078095 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078611 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.078922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079015 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079226 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079628 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079853 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.079953 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080778 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.080872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.081839 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082631 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.082957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083287 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.083878 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084020 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084465 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084835 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.084990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085304 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085597 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.085905 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086489 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086790 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.086944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.087972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.088916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089209 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.089920 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.090956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091099 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091341 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091775 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.091917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092491 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.092998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.093882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094090 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.094904 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095213 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095741 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.095841 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096154 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096368 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096685 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.096999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.097982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098295 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098608 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.098918 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099560 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099870 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.099969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100493 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.100920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.101907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102099 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102549 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102799 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.102907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103755 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.103890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104227 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.104907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105122 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.105870 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106258 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106404 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106733 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.106826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107368 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107663 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.107990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.108081 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.108299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.108395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.108626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.108717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.109545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.109649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.109865 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.109967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110282 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110832 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.110993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111152 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.111966 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112294 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112601 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.112907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113108 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113470 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113793 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.113893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.114117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.114217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.114434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.114534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.114772 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115274 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.115803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.116027 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.116125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.116606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.116767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.116910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.117817 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118036 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118136 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118446 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118660 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.118970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119280 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.119914 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120360 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.120859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121355 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121825 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.121994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122465 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.122960 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123275 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123413 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123609 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123718 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.123923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124254 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124654 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.124962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125304 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125637 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125739 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.125947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126272 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126386 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.126933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127072 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.127911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128002 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128320 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128875 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.128976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.129919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130133 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130233 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130443 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130542 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.130840 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131058 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131667 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.131907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132226 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132878 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.132968 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.133182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.133359 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.133507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.133600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.139906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140665 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140665 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.140893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141143 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141438 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141701 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.141953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142084 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142223 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142763 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142854 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.142927 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143438 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143438 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.143969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144198 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144587 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.144931 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145098 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145790 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.145968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.146421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.146564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.146697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.146831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.146950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147357 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.147996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148391 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148792 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.148903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149765 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.149899 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150030 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150255 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150614 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.150991 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151164 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151356 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151532 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.151998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152223 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152413 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152505 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.152774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153098 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153231 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.153968 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154187 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154332 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154464 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154565 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154814 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154814 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.154980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155133 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155305 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155403 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.155674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156860 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.156989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157288 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157491 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157758 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.157946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.158879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159205 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159735 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.159849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160510 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.160808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161026 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161375 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.161999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162093 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162636 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162743 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.162942 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163357 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163874 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.163967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164495 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.164911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.165838 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166368 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166677 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166823 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.166983 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.167912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168207 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168722 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.168823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169105 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169251 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.169937 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170412 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170603 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.170932 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.171034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.171256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.171397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.172150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.172252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.172720 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.172818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173127 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.173796 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174009 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174339 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.174955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175048 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175279 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.175939 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176138 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.176913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177155 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177278 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177841 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.177941 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178155 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.178939 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179090 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179714 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.179813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180123 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180424 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.180956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181056 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181701 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.181920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182335 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182658 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182864 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.182970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183273 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.183905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184207 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184519 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.184882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185036 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.185996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186458 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186625 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186772 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.186940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187274 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187456 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187662 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.187976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188609 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.188928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189692 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.189917 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190669 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.190890 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.191896 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.192881 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193786 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.193880 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.194834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195165 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195460 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.195784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196406 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.196940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197033 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.197923 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198025 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198243 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198568 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198884 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.198983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199200 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199300 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199515 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.199933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200152 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200244 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200779 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.200878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201098 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201565 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.201867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202105 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202198 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202801 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.202902 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.203889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204441 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.204852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.205067 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.205173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.205334 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:32:24.205431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.205758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.206096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.206427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.206742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.207055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.207373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.207691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.208028 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.208368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.208692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.209024 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.209371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.209706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.210025 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.210356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.210688 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.211014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.211336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.211677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.212000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.212321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.212642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.212963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.213307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.213633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.213967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.214302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.214616 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.214950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.215274 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.215603 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.215929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.216249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.216584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.216905 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.217228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.217576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.217898 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.218737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.219067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.219401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.219733 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.220068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.220404 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.220758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.221077 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.221465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.221804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.222126 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.222447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.222761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:32:24.223012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:32:24.228736 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_db.sqlalchemy.engines [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.245694 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_db.sqlalchemy.engines [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.292671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.context [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b177d00-4ec8-4b1e-aaf9-b063453fd96c(cell1) {{(pid=122879) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 05:32:24.297895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:32:24.299494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:32:24.300322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:32:24.302291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:32:24.309633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.context [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b177d00-4ec8-4b1e-aaf9-b063453fd96c(cell1) {{(pid=122878) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 05:32:24.313123 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_db.sqlalchemy.engines [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.313998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_db.sqlalchemy.engines [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.314142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:32:24.315642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:32:24.316495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:32:24.318518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:32:24.329852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_db.sqlalchemy.engines [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.331280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_db.sqlalchemy.engines [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.479891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_db.sqlalchemy.engines [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.494449 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_db.sqlalchemy.engines [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:32:24.932016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: WARNING keystonemiddleware.auth_token [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:32:24.939210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: WARNING keystonemiddleware.auth_token [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:32:24.964670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: WARNING keystonemiddleware.auth_token [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:32:24.971665 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: WARNING keystonemiddleware.auth_token [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:32:25.174317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: WARNING keystonemiddleware.auth_token [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:32:25.179515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: WARNING keystonemiddleware.auth_token [None req-7407e9f9-276d-4139-9f87-296860bf2fd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:32:25.185056 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e7647c9c0 pid: 122879 (default app) Feb 16 05:32:25.225153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: WARNING keystonemiddleware.auth_token [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 05:32:25.230368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: WARNING keystonemiddleware.auth_token [None req-84e2b8d7-1f69-4028-a266-4d724f471b0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 05:32:25.236219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e7647c9c0 pid: 122878 (default app) Feb 16 05:33:01.413179 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-553fb4a6-709b-4b41-a180-26a9706986be tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Action: 'create', calling method: .version_select at 0x7fc5934ee550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1419166154"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:01.749396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1587261565", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "a7e424d6-266f-483c-9f77-54749ea51752"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:02.194830 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] validate_networks() for [('a7e424d6-266f-483c-9f77-54749ea51752', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:02.888746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-553fb4a6-709b-4b41-a180-26a9706986be tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.658288 Feb 16 05:33:02.891469 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1154 bytes} [Wed Feb 16 05:33:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2663 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 16 05:33:03.001222 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304363785", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "8cb1fb16-d79c-49c4-8a9e-84b03bfe3409"}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:03.153034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] validate_networks() for [('8cb1fb16-d79c-49c4-8a9e-84b03bfe3409', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:03.839993 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:03.841237 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:03.841765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:03.845482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:03.846280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:03.877348 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:03.879442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:03.881740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:03.882742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:03.960651 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Getting quotas for project f8c0817ca34947d797da354bfc2aa372. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:03.987530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Getting quotas for user 937df27c7eb1402b80a735a24170f074 and project f8c0817ca34947d797da354bfc2aa372. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:04.016763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:04.024583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:04.196648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c1893b98-7ab5-45b6-bd85-7078f2ef83d7 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.946912 Feb 16 05:33:04.200071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 1/2] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:33:04.214666 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-13fd05f8-6055-4cb7-9138-32ec9aee3096 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc59335a430>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:04.352617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-13fd05f8-6055-4cb7-9138-32ec9aee3096 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 200 len: 346 microversion: 2.1 time: 0.140945 Feb 16 05:33:04.353383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:33:04 2022] GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:04.365194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7e7d964b-5142-4af2-93a7-241c2dad16eb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:04.366118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7e7d964b-5142-4af2-93a7-241c2dad16eb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:04.461379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7e7d964b-5142-4af2-93a7-241c2dad16eb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:04.483121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7e7d964b-5142-4af2-93a7-241c2dad16eb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1215 microversion: 2.1 time: 0.121771 Feb 16 05:33:04.485927 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:04 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:04.490637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eeb868c5-e209-4d64-ab96-145a33886141 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Action: 'create', calling method: .version_select at 0x7fc592268430>, body: {"snapshot": {"volume_id": "cf355e0a-7999-4c4d-a962-c50d817fc84c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1095232162"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:04.875035 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eeb868c5-e209-4d64-ab96-145a33886141 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.387720 Feb 16 05:33:04.882455 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 4/5] 10.222.0.75 () {60 vars in 1161 bytes} [Wed Feb 16 05:33:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:04.886508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eae059d6-527c-4eab-b37f-5eef0b625b73 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc592268a60>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:04.975513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eae059d6-527c-4eab-b37f-5eef0b625b73 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.093081 Feb 16 05:33:04.980996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 5/6] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:04 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:04.987018 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ac2504d9-146e-41f0-b230-8dc5dd9cca41 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc59227d160>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:05.050321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ac2504d9-146e-41f0-b230-8dc5dd9cca41 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.067827 Feb 16 05:33:05.051109 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 6/7] 10.222.0.75 () {58 vars in 1139 bytes} [Wed Feb 16 05:33:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:05.063011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-44caf3fd-eebd-464d-9d16-f3efbf122aa0 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922893a0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:05.097187 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-44caf3fd-eebd-464d-9d16-f3efbf122aa0 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.038745 Feb 16 05:33:05.102294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 7/8] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:05 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:05.476276 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:05.476806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:05.477161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:05.477611 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:05.478024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:05.502287 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f0f8b7d8-d76e-4a75-b918-1692f40eddac tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:05.502898 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f0f8b7d8-d76e-4a75-b918-1692f40eddac tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:05.507506 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:05.509117 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:05.511516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:05.512848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:05.565665 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:05.574950 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for user 65045a2a88084c12aeb9133bf0162193 and project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:05.594193 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:05.597613 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:05.647976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f0f8b7d8-d76e-4a75-b918-1692f40eddac tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:05.658561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f0f8b7d8-d76e-4a75-b918-1692f40eddac tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1215 microversion: 2.1 time: 0.159917 Feb 16 05:33:05.670882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 8/9] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:05 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:05.745433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e933d681-4c89-403a-828b-1e9f4838016e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839176 Feb 16 05:33:05.746234 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 2/10] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:33:05.756921 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a60bfcf1-cc85-4ba9-9733-acd6b31ffa06 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:05.757901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a60bfcf1-cc85-4ba9-9733-acd6b31ffa06 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:05.906347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a60bfcf1-cc85-4ba9-9733-acd6b31ffa06 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:05.914467 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a60bfcf1-cc85-4ba9-9733-acd6b31ffa06 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1218 microversion: 2.1 time: 0.161727 Feb 16 05:33:05.919913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 9/11] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:05 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:06.110648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-fa4cfe33-16bd-49bd-b5cf-2281c8d25f16 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5932c6af0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:06.166820 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-fa4cfe33-16bd-49bd-b5cf-2281c8d25f16 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.061099 Feb 16 05:33:06.167514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 3/12] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:06 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:06.678548 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:06.679446 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:06.686593 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:06.687615 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:06.688522 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:06.689077 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:06.941903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3420d0cb-7c33-46b1-87b6-958e1fc52d74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:06.942518 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3420d0cb-7c33-46b1-87b6-958e1fc52d74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:07.046455 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:07.065868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-85b17b6c-40ea-49f8-bb78-1138e3564f9d tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1219 microversion: 2.1 time: 0.391454 Feb 16 05:33:07.067771 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 10/13] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:06 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1219 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:07.122330 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3420d0cb-7c33-46b1-87b6-958e1fc52d74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:07.143908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3420d0cb-7c33-46b1-87b6-958e1fc52d74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1218 microversion: 2.1 time: 0.205477 Feb 16 05:33:07.148681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 4/14] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:06 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:07.179586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cd9bcbfd-b979-43fe-b565-b2be008772db tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc592289670>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:07.230546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cd9bcbfd-b979-43fe-b565-b2be008772db tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.055677 Feb 16 05:33:07.231241 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 11/15] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:07 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:08.085415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:08.088544 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:08.101952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:08.105432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:08.108161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:08.108928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:08.164165 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:08.164989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:08.183502 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:08.185325 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:08.189935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:08.191788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:08.360442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:08.373016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d95e611f-15bf-4eef-8362-b8340bbe7490 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1222 microversion: 2.1 time: 0.212028 Feb 16 05:33:08.381817 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 12/16] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:08 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:08.414844 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-65c7d3cd-2a21-4d55-9c75-4455f7bfaedf tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922081f0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:08.468026 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-65c7d3cd-2a21-4d55-9c75-4455f7bfaedf tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 288 microversion: 2.1 time: 0.073343 Feb 16 05:33:08.468606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 13/17] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:08 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:08.479371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-51818b7e-4b1d-4e30-ac9e-f882ea7357af tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5921f8940>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:08.561322 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-51818b7e-4b1d-4e30-ac9e-f882ea7357af tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 202 len: 0 microversion: 2.1 time: 0.084815 Feb 16 05:33:08.562020 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 14/18] 10.222.0.75 () {58 vars in 1253 bytes} [Wed Feb 16 05:33:08 2022] DELETE /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 05:33:08.571884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-67001f7d-d090-4e68-8512-989a909642b1 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922129d0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:08.620655 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-67001f7d-d090-4e68-8512-989a909642b1 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.054172 Feb 16 05:33:08.625972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 15/19] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:08 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:08.647811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:08.666172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0154b649-f063-4034-aa8d-b51ae97f2682 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1219 microversion: 2.1 time: 0.584314 Feb 16 05:33:08.668505 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 5/20] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:08 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1219 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:09.397990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:09.398471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:09.408658 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:09.409121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:09.409976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:09.410412 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:09.527788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:09.543767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f1ef7a0f-0d8f-4456-a94a-710dd9ef21b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1214 microversion: 2.1 time: 0.149374 Feb 16 05:33:09.554806 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 16/21] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:09 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:09.644014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ca04f175-3324-4468-87f7-e1d75618a171 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5921f6d30>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:09.690489 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:09.691200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:09.702081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:09.703587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:09.704441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:09.704988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:09.711832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ca04f175-3324-4468-87f7-e1d75618a171 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.080883 Feb 16 05:33:09.712725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 6/22] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:09 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:09.862621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:09.870566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ffa91f02-4159-4a08-94c9-b804f2145161 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1211 microversion: 2.1 time: 0.184886 Feb 16 05:33:09.873872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 17/23] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:09 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1211 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:10.565829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:10.566547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:10.579034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:10.579737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:10.582331 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:10.582951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:10.656928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:10.664324 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eaaaf187-2307-45b6-895b-c2a0ef74040d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1214 microversion: 2.1 time: 0.104925 Feb 16 05:33:10.665556 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 18/24] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:10 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:10.712864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: .version_select at 0x7fc59225c4c0>, body: {"keypair": {"name": "tempest-keypair-1257591515"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:10.723970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bff7be31-04c8-4402-84a7-7ee1d0539350 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922081f0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:10.742699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:10.746828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:10.758809 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bff7be31-04c8-4402-84a7-7ee1d0539350 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 200 len: 287 microversion: 2.1 time: 0.038505 Feb 16 05:33:10.759982 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 19/25] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:10 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:10.883338 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:10.902565 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:10.903058 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:10.903321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:10.914926 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:10.915645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:10.917537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:10.918141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:10.928137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-610ce216-1dca-4185-aab9-f6ccd7df5bb2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.392938 Feb 16 05:33:10.928852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 7/26] 10.222.0.75 () {60 vars in 1157 bytes} [Wed Feb 16 05:33:10 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:11.026419 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:11.034498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6268b50e-70c5-4c1e-9132-226c0903e070 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1211 microversion: 2.1 time: 0.146320 Feb 16 05:33:11.035682 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 20/27] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:10 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1211 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:11.683771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:11.684582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:11.725082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:11.736474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:11.740958 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:11.746616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:11.771254 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7ff7704f-c1dc-402b-afe9-598cbd74571f tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922121f0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:11.822213 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-7ff7704f-c1dc-402b-afe9-598cbd74571f tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] HTTP exception thrown: Snapshot a50ae59f-0967-4484-9d99-d0543be99e3d could not be found. Feb 16 05:33:11.823180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7ff7704f-c1dc-402b-afe9-598cbd74571f tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Returning 404 to user: Snapshot a50ae59f-0967-4484-9d99-d0543be99e3d could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:33:11.824022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7ff7704f-c1dc-402b-afe9-598cbd74571f tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d" status: 404 len: 111 microversion: 2.1 time: 0.057174 Feb 16 05:33:11.824581 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 21/28] 10.222.0.75 () {58 vars in 1250 bytes} [Wed Feb 16 05:33:11 2022] GET /compute/v2.1/os-snapshots/a50ae59f-0967-4484-9d99-d0543be99e3d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:33:11.833544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-258cab17-db52-4e98-96ba-dd12618db311 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5934c5430>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:12.079508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-258cab17-db52-4e98-96ba-dd12618db311 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 202 len: 0 microversion: 2.1 time: 0.249938 Feb 16 05:33:12.080697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 22/29] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:33:11 2022] DELETE /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:33:12.086230 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:12.086858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:12.094918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:12.095379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:12.096184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:12.096635 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:12.198596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:12.217734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c01d2dde-8255-42fc-be75-6eb78f1c6e7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1270 microversion: 2.1 time: 0.539077 Feb 16 05:33:12.225236 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 8/30] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:11 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1270 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:12.244916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-51b554df-f001-47fa-86e1-88325ea1f2fa tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc591975160>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:12.309780 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:12.318648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a9f1b890-4af7-465c-bf3f-bb2c35412492 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1275 microversion: 2.1 time: 0.235245 Feb 16 05:33:12.321729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 23/31] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:12 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:12.362476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-51b554df-f001-47fa-86e1-88325ea1f2fa tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 200 len: 345 microversion: 2.1 time: 0.123903 Feb 16 05:33:12.363529 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 9/32] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:33:12 2022] GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:13.242984 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:13.243885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:13.250480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:13.250936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:13.251735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:13.252186 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:13.345556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:13.346943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:13.361720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:13.364581 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:13.368051 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:13.368702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:13.551127 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:13.567121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5687767a-31ff-4315-8c5d-ed81e6ec59b1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1276 microversion: 2.1 time: 0.327829 Feb 16 05:33:13.569963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 24/33] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:13 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:13.591506 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-267ae4c5-44b0-4190-8ec0-eb4e38bca877 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc592163f70>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:13.601398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:13.615165 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ea33e89d-3d4d-4ec0-9bbe-9112a0f1f320 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1273 microversion: 2.1 time: 0.273179 Feb 16 05:33:13.621354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 10/34] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:13 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:13.678098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-267ae4c5-44b0-4190-8ec0-eb4e38bca877 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] HTTP exception thrown: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. Feb 16 05:33:13.678995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-267ae4c5-44b0-4190-8ec0-eb4e38bca877 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Returning 404 to user: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:33:13.680452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-267ae4c5-44b0-4190-8ec0-eb4e38bca877 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 404 len: 109 microversion: 2.1 time: 0.106888 Feb 16 05:33:13.681390 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 25/35] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:33:13 2022] GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:33:13.703401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-087d8101-d677-4b23-8de0-ae7b60beb2dd tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc593d19b80>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:13.776172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-087d8101-d677-4b23-8de0-ae7b60beb2dd tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] HTTP exception thrown: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. Feb 16 05:33:13.776993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-087d8101-d677-4b23-8de0-ae7b60beb2dd tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Returning 404 to user: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:33:13.778576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-087d8101-d677-4b23-8de0-ae7b60beb2dd tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 404 len: 109 microversion: 2.1 time: 0.079249 Feb 16 05:33:13.779272 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 11/36] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:33:13 2022] DELETE /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:33:13.787881 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-edc3cdb8-ce9e-4497-90ec-de31a1e649a5 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Calling method '.version_select at 0x7fc5922081f0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:13.856161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-edc3cdb8-ce9e-4497-90ec-de31a1e649a5 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] HTTP exception thrown: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. Feb 16 05:33:13.856902 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-edc3cdb8-ce9e-4497-90ec-de31a1e649a5 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] Returning 404 to user: Volume cf355e0a-7999-4c4d-a962-c50d817fc84c could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:33:13.859104 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-edc3cdb8-ce9e-4497-90ec-de31a1e649a5 tempest-VolumesSnapshotsTestJSON-2016570947 tempest-VolumesSnapshotsTestJSON-2016570947-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c" status: 404 len: 109 microversion: 2.1 time: 0.075435 Feb 16 05:33:13.860538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 26/37] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:33:13 2022] GET /compute/v2.1/os-volumes/cf355e0a-7999-4c4d-a962-c50d817fc84c => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:33:14.588562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:14.590249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:14.606386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:14.615810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:14.616976 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:14.622534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:14.633744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:14.635285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:14.659429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:14.660242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:14.666782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:14.668760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:14.989615 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:14.999018 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2cfd897b-e7cd-412e-a127-95795f6bbf6b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1273 microversion: 2.1 time: 0.368433 Feb 16 05:33:15.018386 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 27/38] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:14 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1273 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:15.104050 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:15.148507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-423f3846-661e-442c-9674-1871ef486a1b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1276 microversion: 2.1 time: 0.562587 Feb 16 05:33:15.157351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 12/39] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:14 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1276 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:16.066670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:16.070097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:16.099899 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:16.103535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:16.109925 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:16.111358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:16.169602 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:16.171094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:16.184457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:16.199694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:16.205147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:16.207985 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:17.283916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:17.315605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-130337da-6f37-4a69-9ed7-8f137e61ca96 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 1.283311 Feb 16 05:33:17.315814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 28/40] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:16 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:18.307194 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:18.316930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2510f246-3dd8-498d-b55f-db8de263a4ae tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 2.152209 Feb 16 05:33:18.319468 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 13/41] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:16 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:18.333196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:18.334803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:18.344307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:18.347750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:18.351180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:18.354223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:19.336255 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:19.337125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:19.348147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:19.352962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:19.355769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:19.357889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:19.996490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:20.005755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2f6ddcfd-a024-4472-9489-6f44082857fe tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 1.676273 Feb 16 05:33:20.012846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 29/42] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:18 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:20.030610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1267017226", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb181d3-f5c9-4c81-83e2-25a8e00b4c5c"}], "security_groups": [{"name": "tempest-securitygroup--71418412"}], "key_name": "tempest-keypair-1257591515", "user_data": "}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:20.281794 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:20.289878 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3616c830-a1d9-477d-8a27-e20bf0b86e35 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.957708 Feb 16 05:33:20.300896 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 14/43] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:19 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:20.844989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] validate_networks() for [('2eb181d3-f5c9-4c81-83e2-25a8e00b4c5c', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:21.034859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:21.036395 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:21.053724 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:21.062391 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:21.064764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:21.065812 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:22.167793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:22.175406 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ae7d1c1c-c254-4377-8835-20af10b10fe3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 1.144394 Feb 16 05:33:22.175966 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 15/44] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:21 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:22.192084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:22.192702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:22.230695 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:22.236241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:22.240414 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:22.259656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:23.155859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:23.170012 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-98f1d7b6-8549-4d19-83b0-edeb91efab2f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.984441 Feb 16 05:33:23.174199 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 16/45] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:22 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:23.940137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-549504063", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:24.063349 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] validate_networks() for [('d78b6deb-fc45-4cca-b643-a09448659dd2', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:24.319526 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:24.320059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:24.320420 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:24.320835 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:24.322060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:24.336753 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:24.337218 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:24.341238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:24.341965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:24.390741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:24.403297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:24.453289 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:24.465234 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:24.625961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f21e1dba-0114-4538-b6d4-70bd4a7a23a7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 4.609432 Feb 16 05:33:24.627547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 30/46] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:33:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 4614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:33:24.643948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:24.645156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:24.710748 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:24.711207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:24.712016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:24.712462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:26.056402 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:26.057132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:26.057745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:26.058418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:26.058871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:26.105211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:26.119263 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:26.122203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:26.125979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:26.207335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Getting quotas for project 971394cccbfa49b584616f61ed5eb8a2. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:26.230259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Getting quotas for user e83de12959394ba5a75f5881741540a8 and project 971394cccbfa49b584616f61ed5eb8a2. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:26.287024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:26.289566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:26.447275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-20e7f367-49d9-48b7-881d-0f4d35177da2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.271074 Feb 16 05:33:26.448306 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 17/47] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:33:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:33:26.731061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:26.744249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-29ee7d04-56a6-454d-9b78-4cc9cf00f881 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 2.115579 Feb 16 05:33:26.748868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 31/48] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:24 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:26.770161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:26.774820 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:26.807385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:26.809901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:26.813530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:26.815115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:27.360589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: .version_select at 0x7fc591975b80>, body: {"keypair": {"name": "tempest-keypair-983773172"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:27.390113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:27.399435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:27.588267 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:27.601491 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fff4e897-7cd1-498a-b5e6-0f64377aeadf tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.850807 Feb 16 05:33:27.602966 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 32/49] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:26 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:27.884505 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:27.896435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:27.944013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-753a406d-2895-424e-882a-2721afba2ad0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.483848 Feb 16 05:33:27.945473 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 18/50] 10.222.0.75 () {62 vars in 1198 bytes} [Wed Feb 16 05:33:26 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1489 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:33:27.953102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:27.953951 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:27.961743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:27.962440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:27.963444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:27.964097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.124996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:28.138798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-422237eb-f86d-4024-9073-01eb6b63bb89 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1296 microversion: 2.1 time: 0.190355 Feb 16 05:33:28.139566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 19/51] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:27 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:28.154372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:28.156466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:28.171951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8596d3-9d2e-455a-bd97-3dc0a5041433", "tag": "8d087470-c4c7-4519-8a95-7e5a1cfd99b4"}, {"name": "network-changed", "server_uuid": "c17fb4ec-2dea-41d2-acff-bf1c3e982833", "tag": "f95645a6-2fbd-42df-b9db-d604a04d8bfa"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:28.174180 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.174329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:28.174329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:28.175020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.176369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.176999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.208319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.208797 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.309796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Creating event network-changed:8d087470-c4c7-4519-8a95-7e5a1cfd99b4 for instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 on hv-cinder-82947 Feb 16 05:33:28.310373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Creating event network-changed:f95645a6-2fbd-42df-b9db-d604a04d8bfa for instance c17fb4ec-2dea-41d2-acff-bf1c3e982833 on hv-cinder-82947 Feb 16 05:33:28.310893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4a8997cb-360e-4ada-b7d4-404497ed8968 req-08863f86-4bdb-4067-8c63-93c06dfd19a7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 16 05:33:28.319708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.329152 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.330188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.330637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.365696 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:28.370465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.compute.rpcapi [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 16 05:33:28.373105 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2bf4f14d-7719-4d18-a200-0bbd06a8d337 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1273 microversion: 2.1 time: 0.232141 Feb 16 05:33:28.375283 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] Releasing lock "compute-rpcapi-router" {{(pid=122878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 16 05:33:28.378216 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 20/52] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:28 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:28.394990 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:28.396175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:28.417341 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.418804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.420203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.422670 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.429033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-697110ec-4b88-41db-b92f-e690e4b1d86f None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.824391 Feb 16 05:33:28.430166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 33/53] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:28.618699 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:28.620063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:28.635644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.636327 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:28.640780 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:28.641465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:29.091298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:29.098651 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-77f921f8-e5eb-45ec-8c82-572d00e68d35 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.719064 Feb 16 05:33:29.099241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 21/54] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:28 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:29.120606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-832631421", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:29.206929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] validate_networks() for [('d78b6deb-fc45-4cca-b643-a09448659dd2', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:29.660535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:29.678045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-feee3b98-2bc7-44fc-8733-32ec4fea283d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 1.063414 Feb 16 05:33:29.689328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 34/55] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:28 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:29.689328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:29.689328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:29.694779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:29.695247 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:29.696102 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:29.696549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.540160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:30.541308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:30.541945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:30.542530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:30.543095 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:30.559174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.559636 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.564580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.565172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.618197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Getting quotas for project 971394cccbfa49b584616f61ed5eb8a2. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:30.627277 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Getting quotas for user e83de12959394ba5a75f5881741540a8 and project 971394cccbfa49b584616f61ed5eb8a2. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:30.671175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:30.673382 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:30.801720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cd8c9f34-b513-484d-a46e-c1a59355e1f8 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.701357 Feb 16 05:33:30.802430 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 22/56] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:33:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:33:30.812077 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:30.812696 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:30.858681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.859451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.863388 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.865227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.871114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:30.886693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d889d862-46c5-4cd5-a172-03fe743fea03 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 1.204432 Feb 16 05:33:30.887536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 35/57] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:29 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:30.901363 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:30.903600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:30.913633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.914177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:30.914873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:30.926024 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:31.180585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:31.188562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2394c8ad-c405-47cd-8b01-f43277cc6a1a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.380136 Feb 16 05:33:31.203727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 23/58] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:30 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:31.212292 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-00c2bcf8-a350-49fe-a639-8786653bb3a6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:31.216080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-00c2bcf8-a350-49fe-a639-8786653bb3a6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:31.919840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-00c2bcf8-a350-49fe-a639-8786653bb3a6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:31.936514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-00c2bcf8-a350-49fe-a639-8786653bb3a6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1221 microversion: 2.1 time: 0.731396 Feb 16 05:33:31.937527 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 24/59] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:31 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1221 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:31.946597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:31.947747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:31.970569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:31.971471 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:31.975059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:31.977740 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:32.100510 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:32.111641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-22101279-45b4-4efa-aa86-80618fa8dab3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 1.222838 Feb 16 05:33:32.117092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 36/60] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:30 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:32.208773 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:32.209743 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:32.240652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:32.242600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:32.245843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:32.246499 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:32.514861 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:32.525562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7e7fe1a9-f67b-484b-9abb-efcdf9ace948 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.586743 Feb 16 05:33:32.529805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 25/61] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:31 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:32.783333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:32.803169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-21f27576-9195-4737-a67d-6cc8a436668a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.599134 Feb 16 05:33:32.819198 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 37/62] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:32 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:32.912297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1735786691", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bff5ceb-655f-4b77-9e4f-6947f831595a"}], "security_groups": [{"name": "tempest-securitygroup--856039875"}], "key_name": "tempest-keypair-983773172", "user_data": "}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:32.956939 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:32.958118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:32.968473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:32.971212 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:32.972685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:32.974109 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.078553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] validate_networks() for [('8bff5ceb-655f-4b77-9e4f-6947f831595a', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:33:33.110861 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.119904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-94d82d87-d55e-47f1-aae0-989c8ba79468 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1273 microversion: 2.1 time: 0.167593 Feb 16 05:33:33.120496 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 38/63] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:32 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:33.132040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-a8dd56fc-10a4-4186-9874-15d44b8ca6d5 req-23327e73-2500-489e-b023-15080e829f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bbecd5-0b2b-42ad-905e-cff757d16934", "tag": "ea0bb21c-e630-4bb0-9c90-163cf454c5fa"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:33.134173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:33.134173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:33.151012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-a8dd56fc-10a4-4186-9874-15d44b8ca6d5 req-23327e73-2500-489e-b023-15080e829f22 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.151639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-a8dd56fc-10a4-4186-9874-15d44b8ca6d5 req-23327e73-2500-489e-b023-15080e829f22 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.170605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-a8dd56fc-10a4-4186-9874-15d44b8ca6d5 req-23327e73-2500-489e-b023-15080e829f22 service nova] Creating event network-changed:ea0bb21c-e630-4bb0-9c90-163cf454c5fa for instance e7bbecd5-0b2b-42ad-905e-cff757d16934 on hv-cinder-82947 Feb 16 05:33:33.177893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-a8dd56fc-10a4-4186-9874-15d44b8ca6d5 req-23327e73-2500-489e-b023-15080e829f22 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055421 Feb 16 05:33:33.180695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 39/64] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:33.188110 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:33.188912 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:33.196456 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.197223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.198446 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.199064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.423607 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.431784 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b2408928-b386-4307-834a-ac6f433074f2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.249629 Feb 16 05:33:33.442188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 40/65] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:33 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:33.542684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:33:33.548525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:33.549090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:33:33.549732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:33:33.550533 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:33:33.551132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:33:33.555740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:33.566641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.567088 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.568957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.569881 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.571321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.572077 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.573091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.573745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.599474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:33:33.607169 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:33:33.620235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:33:33.623017 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:33:33.692101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6b7f86fc-292c-4ad2-8714-2a9b4329de2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.784657 Feb 16 05:33:33.698027 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 26/66] 10.222.0.75 () {62 vars in 1187 bytes} [Wed Feb 16 05:33:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 16 05:33:33.704283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:33.705126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:33.744985 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.755681 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-faf6a976-0506-4597-bb67-6e5fcb2a47d3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.211676 Feb 16 05:33:33.758560 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 41/67] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:33 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:33.771412 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.780555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.782760 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:33.784101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-bf7968a7-7aeb-4b1f-b0f3-06464f9204f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1281 microversion: 2.20 time: 0.084656 Feb 16 05:33:33.795942 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 27/68] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:33 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:33.824130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:33.825856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:33.833437 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.833889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:33.834826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:33.835269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.030301 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:34.038302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f4173ae1-218b-4175-bb65-a94c406a5282 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.218230 Feb 16 05:33:34.048751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 42/69] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:33 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:34.147083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:34.151873 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:34.161115 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.162124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.163144 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.163781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.233883 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:34.241902 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-43be5bed-e5b0-43c3-9729-26e8f7ead790 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1273 microversion: 2.1 time: 0.107052 Feb 16 05:33:34.242670 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 28/70] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:34 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:34.449786 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:34.451132 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:34.458416 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.458856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.459642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.460108 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.595106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:34.604219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5ea58d57-0ceb-4a37-8b5e-52f5b6ac63eb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.158781 Feb 16 05:33:34.604842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 43/71] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:34 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:34.776399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:34.777326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:34.804969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:34.805727 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:34.830650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.831176 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.839628 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.840091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.851067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.851613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:34.852442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:34.855987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.137034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.144737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ab79f3e1-f349-4fbd-a451-c3fc245935c4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.372765 Feb 16 05:33:35.148354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 29/72] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:34 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:35.158555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:35.159575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:35.168396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.169986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.171125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.172054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.237703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.249075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.250658 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.256997 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3870d2a4-6b8e-408d-a761-067189ff9552 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1277 microversion: 2.20 time: 0.457083 Feb 16 05:33:35.268225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 44/73] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:34 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1277 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:35.268225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:35.270269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:35.280753 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.281345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.282156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.282856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.498238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.500978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:35.510239 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c078518d-3b42-48c4-9822-ece50fd00d7f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.360018 Feb 16 05:33:35.510922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b9c3404e-4db8-4b60-a9b1-4781ebc2ad8b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1279 microversion: 2.1 time: 0.251463 Feb 16 05:33:35.511516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 45/74] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:35 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:35.515953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 30/75] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:35 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:35.620830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:35.621347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:35.630268 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.631413 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:35.632379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:35.633785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.077161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.085764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3ae7ba6d-dc6b-4cbd-8258-dd88ab9ce38f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.469342 Feb 16 05:33:36.086374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 31/76] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:35 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:36.164842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:36.165667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:36.172837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.174178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.175431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.176122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.195596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-33480c7d-9b6c-4e1d-87e1-b820d1ef8dd8 req-259e5746-9cf8-4d8e-8a34-9f9b07a4921a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032cece1-a548-4e1f-a72a-b3647d09718c", "tag": "b086e2fa-4423-4f0a-ab73-6efbf20ec756"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:36.198562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:36.198562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:33:36.208654 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-33480c7d-9b6c-4e1d-87e1-b820d1ef8dd8 req-259e5746-9cf8-4d8e-8a34-9f9b07a4921a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.209384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-33480c7d-9b6c-4e1d-87e1-b820d1ef8dd8 req-259e5746-9cf8-4d8e-8a34-9f9b07a4921a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.229933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-33480c7d-9b6c-4e1d-87e1-b820d1ef8dd8 req-259e5746-9cf8-4d8e-8a34-9f9b07a4921a service nova] Creating event network-changed:b086e2fa-4423-4f0a-ab73-6efbf20ec756 for instance 032cece1-a548-4e1f-a72a-b3647d09718c on hv-cinder-82947 Feb 16 05:33:36.230464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-33480c7d-9b6c-4e1d-87e1-b820d1ef8dd8 req-259e5746-9cf8-4d8e-8a34-9f9b07a4921a service nova] Acquired lock "compute-rpcapi-router" {{(pid=122879) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 16 05:33:36.231645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.232583 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.233400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.233832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.242859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.compute.rpcapi [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 16 05:33:36.244089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-edf475be-7033-4109-9821-cf6805903e57 None None] Releasing lock "compute-rpcapi-router" {{(pid=122879) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 16 05:33:36.260271 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-edf475be-7033-4109-9821-cf6805903e57 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068171 Feb 16 05:33:36.261838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 32/77] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:36.276708 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:36.277607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:36.285574 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.286029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.287848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.288302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.340292 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.348075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-36601e3a-ce7c-4d25-864b-f5d7ee960050 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.187112 Feb 16 05:33:36.348650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 46/78] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:36 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:36.360925 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.368688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.370241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.371338 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f1cbe56b-7055-4e2b-acba-3da54b31cb73 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1339 microversion: 2.20 time: 0.098919 Feb 16 05:33:36.371896 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 33/79] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:36 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:36.527837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:36.528440 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:36.532626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:36.533562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:36.535504 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.536119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.537782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.538369 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.540822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.540822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.541657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:36.542094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:36.678103 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.685943 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2e1d15e3-d14c-4141-aabf-430907c66d40 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.161720 Feb 16 05:33:36.686527 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 47/80] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:36 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:36.688638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:36.696520 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ebf99d93-d5e0-4431-8c77-403de3266b00 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.168120 Feb 16 05:33:36.697117 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 34/81] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:36 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:37.102131 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:37.102735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:37.108976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.109445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.110213 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.110646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.241377 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.249145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3cfa919b-a113-4cc1-a5db-b7b57c25eec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.150686 Feb 16 05:33:37.249738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 48/82] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:37 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:37.364013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:37.364621 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:37.370513 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.370960 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.371733 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.372166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.388947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:37.389661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:37.395312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.395752 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.396520 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.396947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.456039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.463918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.465462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.467067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-343a6b37-33d9-4600-acd8-c989dc8650d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1339 microversion: 2.20 time: 0.081784 Feb 16 05:33:37.467632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 49/83] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:37 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:37.501125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.508351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6d2e0f4e-9b73-4883-b180-742c95f6ec20 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.148033 Feb 16 05:33:37.508920 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 35/84] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:37 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:37.704656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:37.705282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:37.711189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.711635 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.712401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.712835 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.713230 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:37.713874 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:37.720191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.720620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.721434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:37.721873 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:37.843676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.850884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-63925323-5981-4532-90c5-4203eaebe511 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.151804 Feb 16 05:33:37.851188 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:37.851480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 50/85] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:37 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:37.858848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cf43986d-a772-4912-bfb8-3a52a5062aea tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.149260 Feb 16 05:33:37.859508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 36/86] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:37 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:38.265815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:38.266421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:38.273319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.273771 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.274536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.274967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.409282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:38.416389 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-35b6c650-c268-4713-a1d3-fad73263a78d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.154821 Feb 16 05:33:38.416953 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 51/87] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:38 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:38.485098 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:38.486081 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:38.491649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.492084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.492852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.493300 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.524761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:38.525406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:38.532514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.532970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.533797 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.534238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.564520 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:38.574477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:38.577642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:38.579859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-36871b4f-81d9-4cc5-bd6e-780b0fce0946 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1339 microversion: 2.20 time: 0.099027 Feb 16 05:33:38.580947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 37/88] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:38 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:38.876337 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:38.878612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:38.879947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:38.890748 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-63fe5bce-4377-41d3-879d-aabf3a40ab36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.369718 Feb 16 05:33:38.892073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 52/89] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:38 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:38.904113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.907226 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.908989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.909757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:38.911186 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.911684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:38.928293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.928749 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:38.934054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:38.935921 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.316118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:39.323458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a454d6c5-92d7-4ff8-8964-eaaca9322d67 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.430231 Feb 16 05:33:39.325999 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 53/90] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:38 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:39.434454 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:39.449929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9beee652-4b68-4a7b-bd19-7d063398e4d1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.584018 Feb 16 05:33:39.450761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 38/91] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:38 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:39.459645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:39.459645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:39.472881 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.473360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.474162 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.474595 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.653018 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-2342e953-23df-4dd4-864a-03cadbd4d7f2 req-adb4f48c-493f-4ed0-a4ed-1dffa49d468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17fb4ec-2dea-41d2-acff-bf1c3e982833", "name": "network-vif-plugged", "status": "completed", "tag": "f95645a6-2fbd-42df-b9db-d604a04d8bfa"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:39.655173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:39.655173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:39.667099 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-2342e953-23df-4dd4-864a-03cadbd4d7f2 req-adb4f48c-493f-4ed0-a4ed-1dffa49d468b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.667550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-2342e953-23df-4dd4-864a-03cadbd4d7f2 req-adb4f48c-493f-4ed0-a4ed-1dffa49d468b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.706414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-2342e953-23df-4dd4-864a-03cadbd4d7f2 req-adb4f48c-493f-4ed0-a4ed-1dffa49d468b service nova] Creating event network-vif-plugged:f95645a6-2fbd-42df-b9db-d604a04d8bfa for instance c17fb4ec-2dea-41d2-acff-bf1c3e982833 on hv-cinder-82947 Feb 16 05:33:39.712328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-2342e953-23df-4dd4-864a-03cadbd4d7f2 req-adb4f48c-493f-4ed0-a4ed-1dffa49d468b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385138 Feb 16 05:33:39.718712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 54/92] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:39.724427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:39.725358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:39.733817 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.734473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.735645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.736223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.860553 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:39.881934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:39.886192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:39.887485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e0a6d6a6-968c-40e5-a3f5-1cb55ff3ceef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1339 microversion: 2.20 time: 0.167325 Feb 16 05:33:39.892396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 55/93] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:39 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:39.909170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:39.910258 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:39.917350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.918020 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:39.919724 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:39.920349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.065507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:40.076592 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c1c296e2-4958-4e3c-baf6-d80d71c9447b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.624653 Feb 16 05:33:40.077206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 39/94] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:39 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:40.331706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:40.339562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-87a1c4e5-8eb4-400b-a46e-e9203c205f5f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.436014 Feb 16 05:33:40.349141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 56/95] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:39 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:40.349329 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:40.349329 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:40.351538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:40.352166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.353232 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:40.353869 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.466792 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:40.467827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:40.484718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:40.485430 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.486589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:40.487171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.733362 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:40.744017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-23d98315-8f92-4b89-bf80-18d32685d954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.279544 Feb 16 05:33:40.746185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 57/96] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:40 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:40.968568 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-c192df12-8bdc-4997-9127-74927bc8bffd req-354e0274-959e-4196-948f-b3e807ff9633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f32b7e4-79a4-47f9-ab79-2d74d3b26190", "tag": "beeb43e2-2312-4e25-8fef-fd7ecfc5800b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:40.970203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:40.970203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:40.982681 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c192df12-8bdc-4997-9127-74927bc8bffd req-354e0274-959e-4196-948f-b3e807ff9633 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:40.983128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c192df12-8bdc-4997-9127-74927bc8bffd req-354e0274-959e-4196-948f-b3e807ff9633 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:40.995377 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-c192df12-8bdc-4997-9127-74927bc8bffd req-354e0274-959e-4196-948f-b3e807ff9633 service nova] Creating event network-changed:beeb43e2-2312-4e25-8fef-fd7ecfc5800b for instance 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 on hv-cinder-82947 Feb 16 05:33:41.002473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-c192df12-8bdc-4997-9127-74927bc8bffd req-354e0274-959e-4196-948f-b3e807ff9633 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218819 Feb 16 05:33:41.003557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 58/97] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:41.015315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:41.016479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:41.022836 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.023558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.024586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.025141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.052683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.062684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-11174bef-7569-4354-beaa-17168251c71a tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.725405 Feb 16 05:33:41.067759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 40/98] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:40 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:41.094059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:41.094957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:41.105026 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.105781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.107657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.108297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.210469 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.223333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.225046 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.226370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7654944d-75e6-4bd6-84f4-c536a5f359da tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.216276 Feb 16 05:33:41.227249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 59/99] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:41 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:41.357479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:41.358207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:41.369010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.370397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.376067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.376067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.533939 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.542010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-78413918-5729-4e81-bd43-001a5af0bb63 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.190013 Feb 16 05:33:41.542769 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 60/100] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:41 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:41.629791 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:41.639598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-451c613f-9936-418a-94c1-41a9d390ae61 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.549337 Feb 16 05:33:41.640747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 41/101] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:41 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:41.730924 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-36361183-c32f-42f5-b1ae-9afc37ccff4f req-8922053a-4be8-4e83-a234-764055dc2cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8596d3-9d2e-455a-bd97-3dc0a5041433", "name": "network-vif-plugged", "status": "completed", "tag": "8d087470-c4c7-4519-8a95-7e5a1cfd99b4"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:41.732518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:41.732518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:41.741926 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-36361183-c32f-42f5-b1ae-9afc37ccff4f req-8922053a-4be8-4e83-a234-764055dc2cfb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.742403 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-36361183-c32f-42f5-b1ae-9afc37ccff4f req-8922053a-4be8-4e83-a234-764055dc2cfb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.754019 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-36361183-c32f-42f5-b1ae-9afc37ccff4f req-8922053a-4be8-4e83-a234-764055dc2cfb service nova] Creating event network-vif-plugged:8d087470-c4c7-4519-8a95-7e5a1cfd99b4 for instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 on hv-cinder-82947 Feb 16 05:33:41.759042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-36361183-c32f-42f5-b1ae-9afc37ccff4f req-8922053a-4be8-4e83-a234-764055dc2cfb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Feb 16 05:33:41.760134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 61/102] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:33:41.777553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:41.777553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:41.785117 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.787575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:41.789212 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:41.790183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.089361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:42.090049 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:42.098675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.099631 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.100573 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.101148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.107110 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.114355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7e3f8eb0-9b0c-405a-b24f-393064a680c0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.353548 Feb 16 05:33:42.114946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 42/103] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:41 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:42.245128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:42.246165 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:42.256310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.256802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.257571 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.258008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.260175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.270385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-208f2dc1-c5eb-445a-9dbf-e0f1c7b93287 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.190126 Feb 16 05:33:42.273306 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 62/104] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:42 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:42.410302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.418019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.420059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.421147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-07ef108b-9ab3-405b-9f91-0b223e04ebb6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.180616 Feb 16 05:33:42.421995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 43/105] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:42 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:42.560202 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:42.560818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:42.566686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.567142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.568097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.568538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.657487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:42.658101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:42.663968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.664432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.665227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:42.669631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:42.725702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.733932 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-af406f99-08ff-4f8d-97f2-b83c4788cf93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.177880 Feb 16 05:33:42.734531 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 63/106] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:42 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:42.803120 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:42.811185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7eb5cb36-efe4-4090-8ccd-12718acd57fb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.157948 Feb 16 05:33:42.811760 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 44/107] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:42 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:43.017799 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-ed140a65-46dc-4406-8999-18ed64a04b12 req-e539feb2-667d-4757-a9ce-33c9975d4685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:43.019357 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:43.019357 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:43.026333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-ed140a65-46dc-4406-8999-18ed64a04b12 req-e539feb2-667d-4757-a9ce-33c9975d4685 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.026779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-ed140a65-46dc-4406-8999-18ed64a04b12 req-e539feb2-667d-4757-a9ce-33c9975d4685 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.037863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-ed140a65-46dc-4406-8999-18ed64a04b12 req-e539feb2-667d-4757-a9ce-33c9975d4685 service nova] Creating event network-changed:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:33:43.042625 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-ed140a65-46dc-4406-8999-18ed64a04b12 req-e539feb2-667d-4757-a9ce-33c9975d4685 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028318 Feb 16 05:33:43.043213 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 64/108] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:43.131459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:43.132076 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:43.138481 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.139104 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.139887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.140322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.280089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.287504 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:43.287994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b687dcd4-2093-488a-80b6-186cd54f4f11 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.159734 Feb 16 05:33:43.288245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:43.288349 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 45/109] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:43 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:43.296481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.296929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.297741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.298171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.440594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:43.441275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:43.447101 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.447414 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.447864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.448642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.449087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.461779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-414553db-ceb6-4eed-bbbe-45bdbee29bab tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.178215 Feb 16 05:33:43.462370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 65/110] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:43 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:43.585361 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.593329 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.594848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.595952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f6594857-ccef-4a4a-b89a-c1872812b52d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.158978 Feb 16 05:33:43.596519 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 46/111] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:43 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:43.751024 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:43.751757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:43.757594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.758151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.758986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.759490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.827594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:43.828314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:43.834151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.834598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.835383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:43.835819 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:43.947445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.955814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-59c83101-9fdc-413e-a3a0-79d06bf2c89a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.208856 Feb 16 05:33:43.962695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 66/112] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:43 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:43.984644 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:43.992217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-61e52cb6-78cc-4a49-81ae-0831919a8102 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.168279 Feb 16 05:33:43.992815 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 47/113] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:43 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:44.303663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:44.304269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:44.310235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.310624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.311421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.312154 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.478464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:44.479680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:44.491893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.493861 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.497163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.497868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.528069 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:44.541212 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-faed0219-5003-4fb2-908c-6bbdf3211954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.241102 Feb 16 05:33:44.542368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 67/114] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:44 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:44.612554 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:44.613378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:44.620160 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.620729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.621814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.622594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.852661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:44.863684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:44.865149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:44.866732 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-242a88c7-28fc-406d-b61d-0355a87b1aea tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.257734 Feb 16 05:33:44.867591 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 68/115] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:44 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:44.974100 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:44.975343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:44.981818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.983001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:44.984472 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:44.985059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.127383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:45.135990 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ad24a3f5-bbaa-45a6-8254-8b91404a7a54 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.661157 Feb 16 05:33:45.136924 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 48/116] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:44 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:45.142405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:45.143195 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:45.149828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.150697 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.151774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.152401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.257657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:45.269388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c69cd3af-ee48-45b0-92ae-2f7735310a5c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.300409 Feb 16 05:33:45.271211 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 69/117] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:44 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:45.364290 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:45.373465 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7da5d832-0d3a-46b5-88ec-94d7b41438fa tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1318 microversion: 2.1 time: 0.234571 Feb 16 05:33:45.374221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 49/118] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:45 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:45.558796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:45.560639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:45.568003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.570641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.572327 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.573206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.790114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:45.798184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bbf66b80-edbd-4067-a1a8-f55fbf3f96fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.243208 Feb 16 05:33:45.798770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 70/119] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:45 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:45.894347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:45.895129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:45.903024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.904129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:45.905415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:45.905891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.153281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:46.154642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:46.160598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.161221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.162596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.163039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.233500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.256593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.258163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.259300 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3df70ab7-09ad-4adf-bf7d-eb452560575b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.371743 Feb 16 05:33:46.262253 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 50/120] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:45 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:46.285952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:46.286827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:46.294843 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.297276 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.302342 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.303039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.462835 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.472904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6d59c902-51d1-4a92-9977-863689f4a8cb tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1315 microversion: 2.1 time: 0.323275 Feb 16 05:33:46.473785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 71/121] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:46 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:46.494640 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:46.496259 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:46.510687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.511140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.513465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.513920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.651865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.669978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e1ad940b-f7f3-4dc5-bb97-506509002f98 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.386300 Feb 16 05:33:46.676000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 51/122] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:46 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:46.761226 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:46.773167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f3e25ff5-99f3-44ef-abca-d249873bd8c5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1508 microversion: 2.1 time: 0.296906 Feb 16 05:33:46.774045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 72/123] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:46 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:46.818147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:46.819124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:46.833094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.833635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:46.835400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:46.835854 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.026680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-fc787d58-6b56-426d-9247-a1e412d834d0 req-134c9e00-a448-424b-a20e-c3f1c70157c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7bbecd5-0b2b-42ad-905e-cff757d16934", "name": "network-vif-plugged", "status": "completed", "tag": "ea0bb21c-e630-4bb0-9c90-163cf454c5fa"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:47.028495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:47.028495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:47.041537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-fc787d58-6b56-426d-9247-a1e412d834d0 req-134c9e00-a448-424b-a20e-c3f1c70157c1 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.045000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-fc787d58-6b56-426d-9247-a1e412d834d0 req-134c9e00-a448-424b-a20e-c3f1c70157c1 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.071588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-fc787d58-6b56-426d-9247-a1e412d834d0 req-134c9e00-a448-424b-a20e-c3f1c70157c1 service nova] Creating event network-vif-plugged:ea0bb21c-e630-4bb0-9c90-163cf454c5fa for instance e7bbecd5-0b2b-42ad-905e-cff757d16934 on hv-cinder-82947 Feb 16 05:33:47.082465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-fc787d58-6b56-426d-9247-a1e412d834d0 req-134c9e00-a448-424b-a20e-c3f1c70157c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060201 Feb 16 05:33:47.083745 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 73/124] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:47.283144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:47.284143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:47.288440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.299965 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-aae520a0-050d-4b17-9a59-7d556f081c67 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.487618 Feb 16 05:33:47.300765 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 52/125] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:46 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:47.317528 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.318733 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.320208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.320855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.490148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:47.491018 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:47.499273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.499712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.500649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.501297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.595185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.603698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.605829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.606986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-aafbcb5b-9aef-44e5-b0f4-a4af0ce9523a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.328958 Feb 16 05:33:47.607695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 74/126] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:47 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:47.692729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:47.693804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:47.703919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.704693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.705692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:47.706129 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:47.796825 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.807822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c81ea651-0f81-47a5-8e08-fd03e8bbcb79 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1502 microversion: 2.1 time: 0.321420 Feb 16 05:33:47.808726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 53/127] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:47 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:47.863145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:47.870552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6a2c9923-4a97-47a2-90d4-39d0a8d11955 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.182559 Feb 16 05:33:47.871131 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 75/128] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:47 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:48.317137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:48.323845 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:48.336124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.336588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:48.344573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.345083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:48.594101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:48.603473 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-56615211-8424-4470-96f0-e66fdc77869a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.290499 Feb 16 05:33:48.604068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 54/129] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:48 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:48.624868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:48.626203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:48.632170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.632777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:48.633756 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.634508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:48.786948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:48.796455 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:48.798171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:48.799390 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6c90f02a-7fd7-42a2-aede-b45d24f52a0d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.178991 Feb 16 05:33:48.800071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 76/130] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:48 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:48.886774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:48.887680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:48.895175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.895870 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:48.896824 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:48.897450 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:49.110092 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:49.118417 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a193b926-e45d-4422-90d0-b2168ff98689 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.235175 Feb 16 05:33:49.119110 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 55/131] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:48 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:49.620580 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:49.621340 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:49.627915 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:49.628547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:49.629388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:49.630045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:49.784218 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:49.793431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b0967edb-6881-4a7d-9ced-3a619cfe74f3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.176920 Feb 16 05:33:49.794955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 77/132] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:49 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:49.816981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:49.817699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:49.825418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:49.825955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:49.826802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:49.827363 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:49.993607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:50.002020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:50.003165 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:50.004427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-14570015-18cb-42f6-bb08-ceb3df806cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.191202 Feb 16 05:33:50.005140 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 56/133] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:49 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:50.138490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:50.139334 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:50.145219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:50.145779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:50.146686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:50.147189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:50.282275 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:50.290574 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-66691ff8-7a08-46df-bd26-c0970bf8cbb0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.159099 Feb 16 05:33:50.291253 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 78/134] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:50 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:50.811124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:50.811739 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:50.817694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:50.818439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:50.819351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:50.819937 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:50.953375 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:50.961454 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3bac2a22-b5b5-4765-b543-f145a399e78d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.153897 Feb 16 05:33:50.962040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 57/135] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:50 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:51.022715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:51.023294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:51.028933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.029422 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.030189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.030619 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.159446 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:51.167035 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:51.168524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:51.169633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-78424630-292f-4963-a75d-5c08ca49c5d3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.150729 Feb 16 05:33:51.170195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 79/136] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:51 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:51.311292 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:51.312134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:51.319723 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.320172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.320956 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.321476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.464269 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:51.471440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1df14635-3856-474d-aa6d-e49aec462305 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1362 microversion: 2.1 time: 0.164453 Feb 16 05:33:51.472006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 58/137] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:51 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:51.587616 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:51.588733 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:51.594811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.595261 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.596037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.596472 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.956353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-07945cb2-32f1-4604-b020-67a2479e466d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372214 Feb 16 05:33:51.956975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 80/138] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:33:51 2022] POST /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:51.978397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:51.984533 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:51.991342 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.992128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:51.993118 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:51.993602 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.134175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:52.142411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-78c6efc9-8faf-498c-96dc-9e819db74ad2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.167588 Feb 16 05:33:52.142993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 59/139] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:51 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:52.188333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:52.189149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:52.196004 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.196457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.197234 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.197693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.351823 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:52.368610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:52.370316 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:52.371416 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bd09971a-6243-46ef-810b-4b28cf963a35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.188156 Feb 16 05:33:52.372145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 81/140] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:52 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:52.460683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79635378-edbd-44df-8432-ea7d3560131c"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:52.462524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:52.470046 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.470488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.471264 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.471913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.488663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:52.489517 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:52.497120 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.497944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.499538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.510636 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.675600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:52.684667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fce27735-6dfc-47e0-a776-093188e84950 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1547 microversion: 2.1 time: 0.199858 Feb 16 05:33:52.685419 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 82/141] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:52 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:33:52.707683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:52.708833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:52.720735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.721317 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.722378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.722970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.831876 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dadf31d5-046a-4500-a7c8-55ba6c89aacb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129057 Feb 16 05:33:52.832947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 83/142] 10.222.0.75 () {58 vars in 1274 bytes} [Wed Feb 16 05:33:52 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:52.839406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-b32f9760-4529-4f5b-abd3-b5cc9762d756 req-a0ebd2de-5ab0-4d05-a066-492fb35dbe5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032cece1-a548-4e1f-a72a-b3647d09718c", "name": "network-vif-plugged", "status": "completed", "tag": "b086e2fa-4423-4f0a-ab73-6efbf20ec756"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:52.845783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:52.845783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:52.855827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-b32f9760-4529-4f5b-abd3-b5cc9762d756 req-a0ebd2de-5ab0-4d05-a066-492fb35dbe5d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:52.857872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-b32f9760-4529-4f5b-abd3-b5cc9762d756 req-a0ebd2de-5ab0-4d05-a066-492fb35dbe5d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:52.879516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-b32f9760-4529-4f5b-abd3-b5cc9762d756 req-a0ebd2de-5ab0-4d05-a066-492fb35dbe5d service nova] Creating event network-vif-plugged:b086e2fa-4423-4f0a-ab73-6efbf20ec756 for instance 032cece1-a548-4e1f-a72a-b3647d09718c on hv-cinder-82947 Feb 16 05:33:52.887562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-b32f9760-4529-4f5b-abd3-b5cc9762d756 req-a0ebd2de-5ab0-4d05-a066-492fb35dbe5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053003 Feb 16 05:33:52.889248 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 84/143] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:53.087335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7b2f18eb-8830-46cb-8cb6-3f70e8498ba6 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "POST /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630928 Feb 16 05:33:53.087894 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 60/144] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:33:52 2022] POST /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:53.160115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:53.161140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:53.173996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:53.174739 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:53.175751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:53.176340 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:53.392749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:53.394251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:53.405539 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:53.406206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:53.407727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:53.408313 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:53.516965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:53.528183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d02d9086-5559-4297-8619-21151027ad71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.371866 Feb 16 05:33:53.529545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 85/145] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:53 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:53.775029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:53.783976 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:53.785589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:53.787159 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1cb6b9ed-a47b-4438-aa3d-cd7b88240ae3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.400614 Feb 16 05:33:53.798852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 61/146] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:53 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:54.409534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:54.410026 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:54.411868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-dc5ac141-a486-49cb-bd88-06ac1b525688 req-4b7fb7af-c607-4ddc-b4e9-c32b3f19cc6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bbecd5-0b2b-42ad-905e-cff757d16934", "tag": "ea0bb21c-e630-4bb0-9c90-163cf454c5fa"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:54.413615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:54.413615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:33:54.416763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.417406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.418185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.418621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.421508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-dc5ac141-a486-49cb-bd88-06ac1b525688 req-4b7fb7af-c607-4ddc-b4e9-c32b3f19cc6c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.423315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-dc5ac141-a486-49cb-bd88-06ac1b525688 req-4b7fb7af-c607-4ddc-b4e9-c32b3f19cc6c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.433168 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-dc5ac141-a486-49cb-bd88-06ac1b525688 req-4b7fb7af-c607-4ddc-b4e9-c32b3f19cc6c service nova] Creating event network-changed:ea0bb21c-e630-4bb0-9c90-163cf454c5fa for instance e7bbecd5-0b2b-42ad-905e-cff757d16934 on hv-cinder-82947 Feb 16 05:33:54.438285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-dc5ac141-a486-49cb-bd88-06ac1b525688 req-4b7fb7af-c607-4ddc-b4e9-c32b3f19cc6c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030072 Feb 16 05:33:54.438996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 62/147] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:54.441862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c40b4785-a3f5-4115-be01-77b14b49a6c3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/ips" status: 200 len: 105 microversion: 2.1 time: 0.036050 Feb 16 05:33:54.442427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 86/148] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:33:54 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/ips => generated 105 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:54.546402 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:54.547121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:54.553646 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.554095 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.554867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.555301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.690688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:54.698088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ea30e5cb-ede8-4d2e-9d2a-824b45c82c19 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.155947 Feb 16 05:33:54.698753 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 63/149] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:54 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:54.805308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:54.805920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:54.811613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.812057 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.812856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.813305 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.904155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-4b7916a0-a6d0-4430-9714-327ae0c06af1 req-dbd099e9-2451-4b93-aef3-f34aec963c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f32b7e4-79a4-47f9-ab79-2d74d3b26190", "name": "network-vif-plugged", "status": "completed", "tag": "beeb43e2-2312-4e25-8fef-fd7ecfc5800b"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:54.906928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:54.906928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:33:54.916969 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-4b7916a0-a6d0-4430-9714-327ae0c06af1 req-dbd099e9-2451-4b93-aef3-f34aec963c82 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:54.917639 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-4b7916a0-a6d0-4430-9714-327ae0c06af1 req-dbd099e9-2451-4b93-aef3-f34aec963c82 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:54.966658 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:54.975578 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:54.977100 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:54.984663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-09a0a1b5-0d1f-4100-a0b2-9e34fbe41a36 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.182850 Feb 16 05:33:54.985288 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 87/150] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:54 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:55.080172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-4b7916a0-a6d0-4430-9714-327ae0c06af1 req-dbd099e9-2451-4b93-aef3-f34aec963c82 service nova] Creating event network-vif-plugged:beeb43e2-2312-4e25-8fef-fd7ecfc5800b for instance 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 on hv-cinder-82947 Feb 16 05:33:55.084989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-4b7916a0-a6d0-4430-9714-327ae0c06af1 req-dbd099e9-2451-4b93-aef3-f34aec963c82 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185239 Feb 16 05:33:55.085634 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 64/151] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:55.718356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:55.719073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:55.726142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:55.726587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:55.727368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:55.727802 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:55.877286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:55.889181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1a8259e0-5241-403d-b128-b6ad4546e1c6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.177354 Feb 16 05:33:55.889799 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 88/152] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:55 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:56.004134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:56.004871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:56.011648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:56.012100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:56.012891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:56.013476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:56.157940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:56.165995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:56.167515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:56.168618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5b8ab983-f68b-4156-b3b5-396ab7c83ec9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.169219 Feb 16 05:33:56.169295 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 65/153] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:55 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:56.906206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:56.906813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:56.913182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:56.913660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:56.914444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:56.914881 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:57.062037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:57.069852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-68063c88-a72d-4d94-a3af-165c37b29402 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.167650 Feb 16 05:33:57.080719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 89/154] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:56 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:57.197652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:57.197652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:57.197652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:57.198260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:57.198685 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:57.199109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:57.370919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:57.380546 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:57.382170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:57.383772 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f415c6d9-4c88-4ab9-92b5-b9725ce2af2c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.196730 Feb 16 05:33:57.384691 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 66/155] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:57 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:58.038216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-ce11ada0-c844-4b82-8ada-552487cd3987 req-0ea0139d-6b0f-4190-a95e-d88c79010e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "name": "network-vif-plugged", "status": "completed", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:58.039824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:58.039824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:33:58.048505 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-ce11ada0-c844-4b82-8ada-552487cd3987 req-0ea0139d-6b0f-4190-a95e-d88c79010e45 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:58.048950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-ce11ada0-c844-4b82-8ada-552487cd3987 req-0ea0139d-6b0f-4190-a95e-d88c79010e45 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:58.060847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-ce11ada0-c844-4b82-8ada-552487cd3987 req-0ea0139d-6b0f-4190-a95e-d88c79010e45 service nova] Creating event network-vif-plugged:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:33:58.065725 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-ce11ada0-c844-4b82-8ada-552487cd3987 req-0ea0139d-6b0f-4190-a95e-d88c79010e45 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Feb 16 05:33:58.066314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 90/156] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:33:58.087101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:58.087720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:58.093551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:58.094009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:58.094789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:58.095227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:58.237657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:58.244784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e0809ba6-99ae-411f-96ec-0eb6bf1be7cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1321 microversion: 2.1 time: 0.161658 Feb 16 05:33:58.245877 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 67/157] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:58 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:58.404207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:58.405509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:58.425073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:58.425929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:58.428285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:58.429626 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:58.604639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:58.607704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:58.608106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:58.609372 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ffa8a5fd-7895-487b-a850-2349625c6e6c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.210139 Feb 16 05:33:58.610401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 91/158] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:58 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:33:59.262865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:59.264010 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:59.270197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.270660 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.271429 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.271865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.410009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:59.417182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ecd7fb33-3b38-477c-8655-64a8b99b26e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1514 microversion: 2.1 time: 0.158006 Feb 16 05:33:59.417770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 68/159] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:59 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:33:59.434146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:33:59.435634 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:59.441796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.442238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.443003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.443436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.469173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lazy-loading 'flavor' on Instance uuid 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:33:59.580409 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-74af7785-e015-48d0-b8b6-1ba0b984d18d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190/action" status: 200 len: 32 microversion: 2.1 time: 0.150035 Feb 16 05:33:59.581027 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 92/160] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:33:59 2022] POST /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:33:59.589734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:59.590335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:59.596717 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.597160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.598034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.599005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.627327 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:33:59.628018 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:33:59.634566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.635021 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.635809 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:33:59.636250 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:33:59.816610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:59.827599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:59.829456 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:59.831150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9a184954-a618-4215-8be6-561f71299585 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1406 microversion: 2.20 time: 0.207827 Feb 16 05:33:59.831935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 93/161] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:33:59 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:33:59.855585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:33:59.870797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6bbe6402-c13d-4365-a7d3-e6965877513a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.284463 Feb 16 05:33:59.871589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 69/162] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:33:59 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:00.849121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:00.849766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:00.857194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:00.857690 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:00.858410 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:00.858824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:00.888738 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:00.889505 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:00.900257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:00.900815 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:00.901749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:00.902427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:01.021912 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:01.033280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:01.035121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:01.036618 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-af9a1355-2df1-4456-a91c-4aa4129900fd tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1597 microversion: 2.20 time: 0.191218 Feb 16 05:34:01.037411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 94/163] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:34:00 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1597 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:34:01.056190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:01.057052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:01.064507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:01.064925 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:01.065875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:01.066307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:01.166775 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b84d7b32-f586-4eea-8488-d38fd0b1cbd4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.114719 Feb 16 05:34:01.167760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 95/164] 10.222.0.75 () {60 vars in 1315 bytes} [Wed Feb 16 05:34:01 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:34:01.203160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:01.213623 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c853fd72-8bce-4ba3-b89c-ecb1b9372989 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.329438 Feb 16 05:34:01.214745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 70/165] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:00 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:02.231436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:02.232889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:02.244345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:02.245762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:02.247136 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:02.247700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:02.502539 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:02.514286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e6174a28-0bd9-4df6-91e2-286054b09e96 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.282565 Feb 16 05:34:02.514286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 96/166] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:02 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:03.166921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:03.168729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:03.170214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-4776a3f9-8b1d-42b5-a8a4-e2afd9f7bcae req-ba119c13-8e67-4095-b729-46f355556858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:03.172284 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:03.172284 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:03.178946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:03.179398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:03.180075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4776a3f9-8b1d-42b5-a8a4-e2afd9f7bcae req-ba119c13-8e67-4095-b729-46f355556858 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:03.180748 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4776a3f9-8b1d-42b5-a8a4-e2afd9f7bcae req-ba119c13-8e67-4095-b729-46f355556858 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:03.181194 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:03.181673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:03.193857 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-4776a3f9-8b1d-42b5-a8a4-e2afd9f7bcae req-ba119c13-8e67-4095-b729-46f355556858 service nova] Creating event network-changed:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:34:03.200723 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-4776a3f9-8b1d-42b5-a8a4-e2afd9f7bcae req-ba119c13-8e67-4095-b729-46f355556858 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 Feb 16 05:34:03.202216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 97/167] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:03.209397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c311f61f-2799-4e38-8e4c-02cbfe94f8bf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/ips" status: 200 len: 111 microversion: 2.20 time: 0.048119 Feb 16 05:34:03.210247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 71/168] 10.222.0.75 () {60 vars in 1288 bytes} [Wed Feb 16 05:34:03 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/ips => generated 111 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:34:03.528970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:03.530222 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:03.541237 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:03.546171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:03.547248 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:03.547847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:03.938088 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:03.950281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-853ee9e8-aa59-4f31-bfab-26c15b190f34 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.425608 Feb 16 05:34:03.951200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 98/169] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:03 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:04.968274 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:04.968896 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:04.975210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:04.975693 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:04.976476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:04.976917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:05.112746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:05.120672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-950ed130-a5ee-4e45-b3f4-1dc3c26a24c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.156712 Feb 16 05:34:05.121421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 72/170] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:04 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:05.541321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1210226484", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "8cb1fb16-d79c-49c4-8a9e-84b03bfe3409"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:05.599785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] validate_networks() for [('8cb1fb16-d79c-49c4-8a9e-84b03bfe3409', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:34:06.138417 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:06.139031 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:06.146744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:06.147196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:06.148158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:06.148972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:06.151463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:34:06.152146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:34:06.152781 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:34:06.153228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:34:06.153698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:34:06.162545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:06.162995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:06.163805 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:06.164241 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:06.181172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:34:06.185788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for user 65045a2a88084c12aeb9133bf0162193 and project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:34:06.196622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:34:06.199010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:34:06.246572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a800b1b2-c35a-41d2-be41-040c5400663b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710058 Feb 16 05:34:06.248617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 99/171] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:34:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:34:06.261782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0c6247a8-6687-4a2d-b1ce-1e50ab4822d2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:06.263546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0c6247a8-6687-4a2d-b1ce-1e50ab4822d2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:06.334443 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0c6247a8-6687-4a2d-b1ce-1e50ab4822d2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:06.344505 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0c6247a8-6687-4a2d-b1ce-1e50ab4822d2 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1218 microversion: 2.1 time: 0.089425 Feb 16 05:34:06.345528 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 100/172] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:06 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:06.365463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:06.383560 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f3561fb7-0817-4f64-b247-e7a8fdead9aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.248029 Feb 16 05:34:06.384335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 73/173] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:06 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:06.546655 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-854594684", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "f5e569ac-f0e9-4164-95dc-8634b19a6e64"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:06.607307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] validate_networks() for [('f5e569ac-f0e9-4164-95dc-8634b19a6e64', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:34:07.065572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:34:07.065975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:34:07.066451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:34:07.066860 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:34:07.067279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:34:07.087857 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.088309 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.089734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.089734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.118720 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Getting quotas for project 434acd7d54a24e18a504c01b72599c36. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:34:07.134147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Getting quotas for user 7e792fde8d97434b95de7a9b58a41d14 and project 434acd7d54a24e18a504c01b72599c36. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:34:07.158915 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:34:07.162826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:34:07.214391 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-62efb7f8-453f-46c0-8e82-ac84e739a621 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672373 Feb 16 05:34:07.215222 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 101/174] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:34:07.226334 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-259c0dcd-2cbd-470f-81d2-bc0b55e104ac tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:07.227496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-259c0dcd-2cbd-470f-81d2-bc0b55e104ac tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:07.325439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-259c0dcd-2cbd-470f-81d2-bc0b55e104ac tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:07.332960 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-259c0dcd-2cbd-470f-81d2-bc0b55e104ac tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1213 microversion: 2.1 time: 0.110782 Feb 16 05:34:07.333826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 74/175] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:07 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:07.362457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:07.363064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:07.370909 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.371861 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.373513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.374532 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.401512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:07.402323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:07.418299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.422141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.423652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:07.426906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:07.484144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:07.493661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-38f0e671-fee1-4c03-9e51-ffc111af595a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1270 microversion: 2.1 time: 0.135405 Feb 16 05:34:07.497638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 102/176] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:07 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:07.952617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:07.961532 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1d30766f-02b9-4b8d-b3f3-91fa29323a3f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.563070 Feb 16 05:34:07.962185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 75/177] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:07 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:08.352043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:08.353868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:08.363695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.364383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:08.365859 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.366737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:08.476392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:08.490324 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-516f4b0e-a8fc-432b-9fd3-430e31de651d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1265 microversion: 2.1 time: 0.143704 Feb 16 05:34:08.491308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 103/178] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:08 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:08.517933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:08.518828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:08.527823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.529180 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:08.530087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.530539 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:08.647063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:08.688215 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-518a25fa-c4b5-41f4-be9b-1c76ef27ac48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1276 microversion: 2.1 time: 0.175838 Feb 16 05:34:08.688215 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 76/179] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:08 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:08.979029 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:08.980225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:08.987541 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.989033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:08.990058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:08.990691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:09.355308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:09.371933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ab172fef-9183-4d36-9b0c-f60e6df9b8f0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.396861 Feb 16 05:34:09.373291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 104/180] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:08 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:09.509818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:09.510900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:09.520144 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:09.521650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:09.522811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:09.523897 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:09.657961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:09.678731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5ae8c087-cac3-44bf-8ed4-cb1544f8146d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1271 microversion: 2.1 time: 0.173934 Feb 16 05:34:09.679424 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 77/181] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:09 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:09.708249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:09.709612 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:09.728873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:09.729668 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:09.730683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:09.732482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.036476 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:10.061737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0b1fa2c4-ac7a-4ce4-a8cc-d4a71b9f9dba tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.360937 Feb 16 05:34:10.063435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 105/182] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:09 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:10.111749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-520d0543-7f73-4ca0-b75e-65bc02646c7d req-ccedc465-36cd-4e2d-9181-2a02f7ceb046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a05cc5-5174-4d41-a407-fc4311b4f6e9", "tag": "5f1e1dcc-fb0d-43bd-a284-85872e5284c7"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:10.113632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:10.113632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:34:10.121130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-520d0543-7f73-4ca0-b75e-65bc02646c7d req-ccedc465-36cd-4e2d-9181-2a02f7ceb046 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:10.121674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-520d0543-7f73-4ca0-b75e-65bc02646c7d req-ccedc465-36cd-4e2d-9181-2a02f7ceb046 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.136344 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-520d0543-7f73-4ca0-b75e-65bc02646c7d req-ccedc465-36cd-4e2d-9181-2a02f7ceb046 service nova] Creating event network-changed:5f1e1dcc-fb0d-43bd-a284-85872e5284c7 for instance 69a05cc5-5174-4d41-a407-fc4311b4f6e9 on hv-cinder-82947 Feb 16 05:34:10.143432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-520d0543-7f73-4ca0-b75e-65bc02646c7d req-ccedc465-36cd-4e2d-9181-2a02f7ceb046 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035139 Feb 16 05:34:10.144139 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 78/183] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:10.389555 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:10.390747 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:10.398351 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:10.399376 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.400364 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:10.401740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.657467 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:10.681863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bb72c43e-7c83-4a26-9f52-5011d0f223fa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.296113 Feb 16 05:34:10.682634 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 106/184] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:10 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:10.700609 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:10.701836 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:10.714893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:10.715341 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.716167 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:10.716700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:10.988638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:10.997554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-20f3695c-4f2b-4bd7-95da-5bece004bf29 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.302598 Feb 16 05:34:11.001675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 79/185] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:10 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:11.033591 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-6a811308-818e-4b0d-bca3-c75233e64177 req-ec903bd5-b461-490c-8d7d-745c0426c8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccde5a1c-d663-470c-bd84-5e48b988b2dd", "tag": "0eac56b7-a543-4943-97d3-45cabe36a813"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:11.035516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:11.035516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:11.053434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-6a811308-818e-4b0d-bca3-c75233e64177 req-ec903bd5-b461-490c-8d7d-745c0426c8eb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:11.054188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-6a811308-818e-4b0d-bca3-c75233e64177 req-ec903bd5-b461-490c-8d7d-745c0426c8eb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:11.071063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-6a811308-818e-4b0d-bca3-c75233e64177 req-ec903bd5-b461-490c-8d7d-745c0426c8eb service nova] Creating event network-changed:0eac56b7-a543-4943-97d3-45cabe36a813 for instance ccde5a1c-d663-470c-bd84-5e48b988b2dd on hv-cinder-82947 Feb 16 05:34:11.076337 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-6a811308-818e-4b0d-bca3-c75233e64177 req-ec903bd5-b461-490c-8d7d-745c0426c8eb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046319 Feb 16 05:34:11.077529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 107/186] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:11.080516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:11.082789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:11.090085 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:11.090566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:11.091360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:11.091797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:11.287218 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:11.295582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-048f7568-5636-44f7-bf3c-409d597e9af4 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.219543 Feb 16 05:34:11.296450 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 80/187] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:11 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:11.701994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:11.702691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:11.710587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:11.711038 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:11.711857 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:11.712293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:11.846349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:11.853738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-246f119a-20a0-4ab2-898d-8152a20cf115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.155831 Feb 16 05:34:11.854316 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 108/188] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:11 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:12.014468 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:12.015079 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:12.021530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.021980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:12.022761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.023196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:12.156316 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:12.163595 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4ee86550-a836-42ef-85f9-1f8150585592 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.153442 Feb 16 05:34:12.164193 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 81/189] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:12 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:12.312423 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:12.313032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:12.319140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.319584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:12.320356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.320791 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:12.450517 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:12.457715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-944ce53c-cb90-4d61-9cb9-d93ed9a79e0a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.149736 Feb 16 05:34:12.458283 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 109/190] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:12 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:12.870732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:12.871339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:12.877890 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.878331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:12.879135 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:12.879535 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:13.019158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:13.027089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-41eb8c90-f8de-43d9-90fe-a6c2ba4e2e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.160011 Feb 16 05:34:13.027655 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 82/191] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:12 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:13.179553 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:13.180162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:13.187038 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:13.187487 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:13.188263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:13.188697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:13.325543 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:13.332875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-50552000-f8f3-4154-82f8-b651ed0a1ae9 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.157024 Feb 16 05:34:13.333483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 110/192] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:13 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:13.474425 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:13.475034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:13.480958 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:13.481442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:13.482242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:13.482672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:13.610663 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:13.617866 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2d31e7e5-eff9-42e0-ab03-808f42c48770 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.147047 Feb 16 05:34:13.618438 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 83/193] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:13 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:14.044232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:14.044845 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:14.051014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.051474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.052256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.052692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.186256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:14.194052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6c0dcb82-379f-434e-9907-0d781888a3e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.154166 Feb 16 05:34:14.194612 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 111/194] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:14 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:14.351702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:14.352817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:14.362050 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.362725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.363751 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.364354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.569336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:14.577337 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9a05cffb-5fd9-4ef5-9c56-37c6bb2d6947 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.230866 Feb 16 05:34:14.577938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 84/195] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:14 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:14.636113 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:14.636847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:14.643715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.644097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.644874 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:14.645338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:14.854611 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:14.862563 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-56a56c49-2344-4c89-8464-fdb274cf97a7 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.230172 Feb 16 05:34:14.863153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 112/196] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:14 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:15.212529 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:15.213151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:15.219336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.219808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:15.220582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.221021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:15.363652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:15.371177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d0ac1ff0-220d-4c91-8660-2c445ce9e296 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.163603 Feb 16 05:34:15.375521 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 85/197] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:15 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:15.594600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:15.595214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:15.601427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.601886 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:15.602676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.603121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:15.751617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:15.759413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6f449d8c-fcd1-429e-9b23-03cd77bc2470 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.169043 Feb 16 05:34:15.760188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 113/198] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:15 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:15.878908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:15.879516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:15.885323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.885795 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:15.886562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:15.886993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.032513 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:16.035122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:16.035617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:16.040822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-26a44f44-09cb-4f38-8df2-810080fc685d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.165486 Feb 16 05:34:16.041468 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 86/199] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:15 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:16.041816 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.042347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.043143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.044123 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.069172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:34:16.151808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b7fee6c3-c723-4ddf-99db-2dd3d0e34ef9 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 204 len: 0 microversion: 2.1 time: 0.120152 Feb 16 05:34:16.152721 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 114/200] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:34:16 2022] DELETE /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 05:34:16.162251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:16.162858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:16.169815 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.171208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.172139 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.172437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.307703 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:16.315491 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c436a5c8-81ee-404f-af48-714af9f3422b tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1554 microversion: 2.1 time: 0.158612 Feb 16 05:34:16.316062 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 87/201] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:16 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:16.389870 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:16.390570 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:16.396358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.396808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.397622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.398061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.536338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:16.544022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b22a0b7a-783e-47f1-8132-29445ed04150 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.159102 Feb 16 05:34:16.544606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 115/202] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:16 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:16.776559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:16.777109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:16.783461 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.783903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.784897 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:16.785355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:16.923171 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:16.930799 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ae77c0a4-2e9c-4998-a4e0-8d8188246650 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.158134 Feb 16 05:34:16.931580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 88/203] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:16 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:17.061660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:17.062413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:17.070315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.070774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.071559 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.071992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.216335 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:17.223544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d6f3646e-1577-4542-9e10-75b148b60f24 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.169508 Feb 16 05:34:17.224117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 116/204] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:17 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:17.333129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:17.333782 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:17.339656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.340107 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.340880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.341378 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.473141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:17.480916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9574bf81-ccc3-4898-9db1-0429a4efd076 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1554 microversion: 2.1 time: 0.151524 Feb 16 05:34:17.481516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 89/205] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:17 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:17.561975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:17.562501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:17.568920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.569774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.570164 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.570601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.705495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:17.712944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3966ecff-daf0-4650-87d1-718c23ccb01b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.155337 Feb 16 05:34:17.713743 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 117/206] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:17 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:17.947499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:17.948230 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:17.954658 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.955296 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:17.956206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:17.956757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.125845 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:18.136709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d68a2dda-b8bd-48f0-8697-2211f5234699 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.192158 Feb 16 05:34:18.138090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 90/207] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:17 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:18.239550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:18.240768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:18.249121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.249978 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.250974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.251606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.478516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:18.499750 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:18.500623 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:18.503774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dacd070c-c62b-4255-af6a-678203cf670d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.267614 Feb 16 05:34:18.505084 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 118/208] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:18 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:18.509029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.509806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.510738 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.511439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.572147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-f074795c-844b-42cc-8ef9-f0a641cad9b2 req-b3664558-a9a2-44f8-a838-066458186942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a05cc5-5174-4d41-a407-fc4311b4f6e9", "name": "network-vif-plugged", "status": "completed", "tag": "5f1e1dcc-fb0d-43bd-a284-85872e5284c7"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:18.573903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:18.573903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:18.582730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-f074795c-844b-42cc-8ef9-f0a641cad9b2 req-b3664558-a9a2-44f8-a838-066458186942 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.583117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-f074795c-844b-42cc-8ef9-f0a641cad9b2 req-b3664558-a9a2-44f8-a838-066458186942 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.595580 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-f074795c-844b-42cc-8ef9-f0a641cad9b2 req-b3664558-a9a2-44f8-a838-066458186942 service nova] Creating event network-vif-plugged:5f1e1dcc-fb0d-43bd-a284-85872e5284c7 for instance 69a05cc5-5174-4d41-a407-fc4311b4f6e9 on hv-cinder-82947 Feb 16 05:34:18.600767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-f074795c-844b-42cc-8ef9-f0a641cad9b2 req-b3664558-a9a2-44f8-a838-066458186942 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Feb 16 05:34:18.603293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 119/209] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:18.730674 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:18.731326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:18.732162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:18.741156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ee4214dc-5661-4447-8478-2822e4342ef2 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1554 microversion: 2.1 time: 0.245721 Feb 16 05:34:18.742530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 91/210] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:18 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:18.744432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.745378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.746836 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:18.748932 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:18.950289 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:18.958629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-09577a7c-53d6-4a65-9d28-e4c6aa3f48c7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.232305 Feb 16 05:34:18.959218 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 120/211] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:18 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:19.155964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:19.156704 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:19.163210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.163855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.165252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.165908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.316472 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:19.324618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5edf9233-fe87-4d9d-af4f-c8b4b42c2830 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.173232 Feb 16 05:34:19.325356 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 92/212] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:19 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:19.526335 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:19.527089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:19.533249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.533826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.534849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.535398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.759917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:19.760704 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:19.767039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.767559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.776802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.776802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.789029 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:19.797019 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e550a93a-e009-42c4-98a2-344fa8bdc4e3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.274799 Feb 16 05:34:19.803969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 121/213] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:19 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:19.946459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:19.956135 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cea8892f-d21b-456a-94aa-72a8ba3b7bff tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1554 microversion: 2.1 time: 0.199888 Feb 16 05:34:19.957903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 93/214] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:19 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:19.975587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:19.976194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:19.988737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.989194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:19.990011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:19.990644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.276808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-b60d2603-ab5b-4c34-9bea-993ff0944c35 req-8fe8d6d8-376d-4773-8a1f-90af1e91429b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8596d3-9d2e-455a-bd97-3dc0a5041433", "name": "network-vif-deleted", "tag": "8d087470-c4c7-4519-8a95-7e5a1cfd99b4"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:20.278620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:20.278620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:34:20.288786 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b60d2603-ab5b-4c34-9bea-993ff0944c35 req-8fe8d6d8-376d-4773-8a1f-90af1e91429b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.289679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b60d2603-ab5b-4c34-9bea-993ff0944c35 req-8fe8d6d8-376d-4773-8a1f-90af1e91429b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.307524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:20.316200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b2fa7595-cc21-4d97-9a12-dbb237b2a2e2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.344054 Feb 16 05:34:20.317702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-b60d2603-ab5b-4c34-9bea-993ff0944c35 req-8fe8d6d8-376d-4773-8a1f-90af1e91429b service nova] Creating event network-vif-deleted:8d087470-c4c7-4519-8a95-7e5a1cfd99b4 for instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 on hv-cinder-82947 Feb 16 05:34:20.318007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 122/215] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:19 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:20.325470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-b60d2603-ab5b-4c34-9bea-993ff0944c35 req-8fe8d6d8-376d-4773-8a1f-90af1e91429b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053518 Feb 16 05:34:20.326106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 94/216] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:20.341033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:20.342325 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:20.349344 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.349798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.350586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.351022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.492007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:20.499161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7f4bd318-72fb-43a4-aba4-f7c9c3eac929 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.161742 Feb 16 05:34:20.499728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 123/217] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:20 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:20.820169 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:20.820919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:20.827548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.827996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.828856 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.829319 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.967072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:20.972828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:20.973490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:20.974435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-33fdceba-0e84-4786-bd4e-487fc393252f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1318 microversion: 2.1 time: 0.158240 Feb 16 05:34:20.975181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 95/218] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:20 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:20.980054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.980741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:20.982160 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:20.982696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.049901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:21.057624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fd51d66c-7841-4bca-a42b-0459e3a2db5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1346 microversion: 2.1 time: 0.088357 Feb 16 05:34:21.058200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 124/219] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:20 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:21.336372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:21.337415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:21.346652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.347315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.348499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.349394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.492022 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:21.500054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c03c8d7d-86f1-43ad-a6c6-fcdacfd17f2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.169440 Feb 16 05:34:21.500640 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 96/220] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:21 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:21.516918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:21.517572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:21.523497 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.523949 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.524740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.525164 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.660063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:21.668482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b46cd42f-a3e0-4962-bf6b-89f6e10e28b3 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.156223 Feb 16 05:34:21.669048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 125/221] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:21 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:21.990617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:21.991267 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:21.997065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.997548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:21.998322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:21.998758 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.074927 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:22.075521 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.082468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.082916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.083703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.084134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.119119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.119684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.120216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lazy-loading 'fault' on Instance uuid 1d8596d3-9d2e-455a-bd97-3dc0a5041433 {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:34:22.167944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937df27c7eb1402b80a735a24170f074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c0817ca34947d797da354bfc2aa372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:22.175865 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c1812777-1a78-4086-9954-e812af06aaf3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 200 len: 1351 microversion: 2.1 time: 0.104603 Feb 16 05:34:22.176800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 126/222] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:22 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:22.184452 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:22.193626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-83b3c8a2-ebb3-48df-b8bd-d374379faee1 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1509 microversion: 2.1 time: 0.206505 Feb 16 05:34:22.194630 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 97/223] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:21 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:22.211552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:22.212895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.220729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.221110 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.221918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.222354 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.244794 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-f4c794d1-9568-473b-9a93-cf7f135c4831 req-ed523887-3ed5-4e09-bd88-d1c4dbc8cb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccde5a1c-d663-470c-bd84-5e48b988b2dd", "name": "network-vif-plugged", "status": "completed", "tag": "0eac56b7-a543-4943-97d3-45cabe36a813"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:22.246674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:22.246674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:34:22.259086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-f4c794d1-9568-473b-9a93-cf7f135c4831 req-ed523887-3ed5-4e09-bd88-d1c4dbc8cb2b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.259556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-f4c794d1-9568-473b-9a93-cf7f135c4831 req-ed523887-3ed5-4e09-bd88-d1c4dbc8cb2b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.273766 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-f4c794d1-9568-473b-9a93-cf7f135c4831 req-ed523887-3ed5-4e09-bd88-d1c4dbc8cb2b service nova] Creating event network-vif-plugged:0eac56b7-a543-4943-97d3-45cabe36a813 for instance ccde5a1c-d663-470c-bd84-5e48b988b2dd on hv-cinder-82947 Feb 16 05:34:22.281070 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-f4c794d1-9568-473b-9a93-cf7f135c4831 req-ed523887-3ed5-4e09-bd88-d1c4dbc8cb2b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041850 Feb 16 05:34:22.282386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 98/224] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:22.311788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Invalid volume: volume 6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f is already attached to instances: c17fb4ec-2dea-41d2-acff-bf1c3e982833 Feb 16 05:34:22.312408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 400 to user: Invalid volume: volume 6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f is already attached to instances: c17fb4ec-2dea-41d2-acff-bf1c3e982833 {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:22.313284 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-36bdbc9a-3c2e-4186-b3bc-6664ebb4f2be tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105800 Feb 16 05:34:22.313862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 127/225] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:34:22 2022] POST /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:34:22.377090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:22.377718 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.384301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.384749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.385555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.385993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.516289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lazy-loading 'services' on Instance uuid c17fb4ec-2dea-41d2-acff-bf1c3e982833 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:34:22.517885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:22.518489 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.526538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.526996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.528206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.531082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.643805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-34cc4c32-9563-4745-9afe-9a36c946fffb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments/6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f" status: 202 len: 0 microversion: 2.1 time: 0.271280 Feb 16 05:34:22.644740 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 99/226] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:34:22 2022] DELETE /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments/6d99ff26-fc1b-4146-b1b7-a0778bd6ae0f => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:34:22.653198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:22.654489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.660840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.661597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.662321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.662998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.714135 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6704d2f1-7291-472e-a382-83f0bd695506 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065078 Feb 16 05:34:22.715108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 100/227] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:22 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:22.720049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:22.725579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:22.732849 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.733910 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.735327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:22.735836 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:22.740812 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:22.749517 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8b509e72-f9fb-4402-a034-bf5346c67b18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.235828 Feb 16 05:34:22.750678 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 128/228] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:22 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:22.885176 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:22.893913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f6c9ab22-382c-4301-afe9-d6ccd0b11dcd tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.177523 Feb 16 05:34:22.894490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 101/229] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:22 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:23.193624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:23.194260 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:23.200969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.201589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.202374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.202814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.216308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] HTTP exception thrown: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. Feb 16 05:34:23.217486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Returning 404 to user: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:23.218309 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f6d547f2-c1ad-449e-a6ec-a9eaa2bcba5f tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 404 len: 111 microversion: 2.1 time: 0.028368 Feb 16 05:34:23.218849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 129/230] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:23 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:23.315254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:23.316035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:23.321972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.322661 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.323687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.324334 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.336924 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] HTTP exception thrown: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. Feb 16 05:34:23.337542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Returning 404 to user: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:23.338367 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-db4ab4ec-c66f-40e3-b70c-212371e00ff3 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027016 Feb 16 05:34:23.338905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 102/231] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:23 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:23.726629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:23.727702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:23.734462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.734946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.735728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.736161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.766192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f467a3bf-52ac-4e4d-a427-3226e944051b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Feb 16 05:34:23.766974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 130/232] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:23 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:23.767846 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:23.768449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:23.774635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.775086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.775847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.776269 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.905627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:23.909728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:23.910339 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:23.914219 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-64c41642-ed12-4786-aec7-103b738be094 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.150673 Feb 16 05:34:23.914871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 103/233] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:23 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:23.923946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.923946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:23.923946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:23.923946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.051604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:24.058755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-56617429-be86-49af-9241-0672c39ad130 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1313 microversion: 2.1 time: 0.152545 Feb 16 05:34:24.059322 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 131/234] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:23 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:24.530124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:24.530702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:24.536863 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.537585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.538808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.539643 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.563573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] HTTP exception thrown: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. Feb 16 05:34:24.564484 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Returning 404 to user: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:24.565459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0c77a9f6-aa6f-4067-9090-0d437772afbf tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 404 len: 111 microversion: 2.1 time: 0.039093 Feb 16 05:34:24.566011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 104/235] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:34:24 2022] DELETE /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:24.573927 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:24.574582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] [instance: 1d8596d3-9d2e-455a-bd97-3dc0a5041433] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:24.580759 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.582589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.583751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.584416 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.600057 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] HTTP exception thrown: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. Feb 16 05:34:24.600761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] Returning 404 to user: Instance 1d8596d3-9d2e-455a-bd97-3dc0a5041433 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:24.601708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-22588c2d-7b4d-4089-8b2f-0b82b2c3c807 tempest-DeleteServersTestJSON-1713014843 tempest-DeleteServersTestJSON-1713014843-project] 10.222.0.75 "GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433" status: 404 len: 111 microversion: 2.1 time: 0.031384 Feb 16 05:34:24.602466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 132/236] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:24 2022] GET /compute/v2.1/servers/1d8596d3-9d2e-455a-bd97-3dc0a5041433 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:24.777829 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:24.780582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:24.796314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.796776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.797606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.798199 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.836508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0c5e74a2-b70d-43b3-8039-b4728cc53404 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063474 Feb 16 05:34:24.837392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 105/237] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:24 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:34:24.931633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:24.932815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:24.940393 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.940945 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:24.942008 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:24.942696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:25.019828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1863087180", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "8cb1fb16-d79c-49c4-8a9e-84b03bfe3409"}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:25.082442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] validate_networks() for [('8cb1fb16-d79c-49c4-8a9e-84b03bfe3409', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:34:25.247124 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:25.255005 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-64e94709-4b9a-4395-b161-004c42c8b36b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.327417 Feb 16 05:34:25.255874 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 133/238] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:24 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:25.260995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:25.261867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:25.268811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:25.269289 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:25.270418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:25.271250 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:25.541422 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:34:25.541885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:34:25.542631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:34:25.543178 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:34:25.543785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:34:25.553421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:25.563962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:25.564666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:25.565755 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:25.566419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:25.566754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dbbab6ff-8745-488b-975d-8c547213b689 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1496 microversion: 2.1 time: 0.309199 Feb 16 05:34:25.567348 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 134/239] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:25 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:25.627065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:34:25.636835 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for user 65045a2a88084c12aeb9133bf0162193 and project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:34:25.654482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:34:25.657705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:34:25.721313 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-238b143e-133a-4b45-a9c7-0f2db2437219 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703308 Feb 16 05:34:25.723123 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 106/240] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:34:25.737939 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fbff1910-723a-4976-9189-5524546bf606 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:25.738866 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fbff1910-723a-4976-9189-5524546bf606 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:25.899478 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fbff1910-723a-4976-9189-5524546bf606 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:25.919227 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fbff1910-723a-4976-9189-5524546bf606 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1218 microversion: 2.1 time: 0.190809 Feb 16 05:34:25.926270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 135/241] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:25 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:26.214455 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:26.214996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:26.224806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.225771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.226061 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.226663 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.254951 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:34:26.272255 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:26.272902 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:26.280106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.281524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.282512 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.283144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.371812 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7f6f590c-7a44-4c2b-938a-40d8eb1a6e90 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 204 len: 0 microversion: 2.1 time: 0.160730 Feb 16 05:34:26.372806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 107/242] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:34:26 2022] DELETE /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:34:26.384698 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:26.386555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:26.398336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.399160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.400639 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.401590 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.492052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:26.517093 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7d52e53f-d0e4-4763-aff6-8a84130bf9e7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.246630 Feb 16 05:34:26.520066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 136/243] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:26 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:26.614860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:26.625158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0f2b5da9-14a7-4cfe-abd6-d1069c634b9f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1502 microversion: 2.1 time: 0.247422 Feb 16 05:34:26.627206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 108/244] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:26 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:26.941826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:26.942568 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:26.948729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.949501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:26.950321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:26.950796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:27.018901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:27.026470 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c492e32f-0c3b-4c83-a91c-6429e549679f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1270 microversion: 2.1 time: 0.088330 Feb 16 05:34:27.027048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 137/245] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:26 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:27.537246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:27.537246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:27.547312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:27.547809 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:27.548837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:27.549498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:27.742179 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-17035900-4a63-4708-b27b-d82350235847 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Action: 'create', calling method: .version_select at 0x7fc59172bdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1619283976", "metadata": {"Type": "work"}}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:27.820615 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:27.828713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e3e1fff0-3680-4056-96de-ffb93b2c376c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.296760 Feb 16 05:34:27.833566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 138/246] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:27 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:27.852076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:27.853201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:27.868738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:27.870373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:27.871695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:27.874239 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:28.138793 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:28.150587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-75e283ac-4a39-4840-b67a-abdbd64fec18 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1502 microversion: 2.1 time: 0.315362 Feb 16 05:34:28.151538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 139/247] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:27 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:28.152052 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-17035900-4a63-4708-b27b-d82350235847 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.726750 Feb 16 05:34:28.152673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 109/248] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:34:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 728 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 16 05:34:28.161412 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:28.162199 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:28.165189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-41553a30-6810-4caa-8026-1a118deba85b tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc591885d30>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:28.171089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:28.171755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:28.173488 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:28.174291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:28.237440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-41553a30-6810-4caa-8026-1a118deba85b tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 200 len: 353 microversion: 2.1 time: 0.076945 Feb 16 05:34:28.243369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 110/249] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:34:28 2022] GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:28.276524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:28.287766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-31289cc3-be02-4b71-acbd-c1eff2b80c9f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1276 microversion: 2.1 time: 0.134743 Feb 16 05:34:28.289998 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 140/250] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:28 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:28.846650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:28.847267 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:28.853880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:28.854336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:28.855145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:28.855578 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:28.996598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:29.004867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-902ae75a-2a2e-425d-bc3f-a99af04607d0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.163272 Feb 16 05:34:29.005784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 111/251] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:28 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:29.168500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.169095 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:29.176074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:29.176531 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:29.177368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:29.177812 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:29.250474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e9bc3c9c-6f95-4364-9e17-d704eebbd72f tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc591885f70>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.299304 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e9bc3c9c-6f95-4364-9e17-d704eebbd72f tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 200 len: 354 microversion: 2.1 time: 0.052320 Feb 16 05:34:29.299885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 112/252] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:34:29 2022] GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:29.313554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.314341 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:29.321882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:29.322512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:29.323488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:29.324097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:29.426003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:29.436334 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0c463b76-9e58-4493-9c36-8b2d5cb5e54d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1502 microversion: 2.1 time: 0.271703 Feb 16 05:34:29.437729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 141/253] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:29 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:29.442503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-13d56fcb-677d-47e0-b8e7-3b3787878fc5 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc592075af0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.495732 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-13d56fcb-677d-47e0-b8e7-3b3787878fc5 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 200 len: 354 microversion: 2.1 time: 0.056283 Feb 16 05:34:29.496190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 142/254] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:34:29 2022] GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:29.514781 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-c98d6f93-666a-48ea-ae27-0243995fbd1f req-6ce3730c-2935-4b6d-80cb-10a7515e1b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a3cf44-4b52-472e-8e55-9209e88f127d", "tag": "1a2ee93b-aa41-40e5-b336-729f04e7e5c2"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:29.517909 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:29.517909 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:29.528280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c98d6f93-666a-48ea-ae27-0243995fbd1f req-6ce3730c-2935-4b6d-80cb-10a7515e1b88 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:29.530558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c98d6f93-666a-48ea-ae27-0243995fbd1f req-6ce3730c-2935-4b6d-80cb-10a7515e1b88 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:29.542240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-c98d6f93-666a-48ea-ae27-0243995fbd1f req-6ce3730c-2935-4b6d-80cb-10a7515e1b88 service nova] Creating event network-changed:1a2ee93b-aa41-40e5-b336-729f04e7e5c2 for instance 64a3cf44-4b52-472e-8e55-9209e88f127d on hv-cinder-82947 Feb 16 05:34:29.547773 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-c98d6f93-666a-48ea-ae27-0243995fbd1f req-6ce3730c-2935-4b6d-80cb-10a7515e1b88 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041081 Feb 16 05:34:29.548484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 143/255] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:29.553965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4ccf967f-cdb1-43df-b486-a37ef75c142b tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc592008040>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.617898 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4ccf967f-cdb1-43df-b486-a37ef75c142b tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 202 len: 0 microversion: 2.1 time: 0.067919 Feb 16 05:34:29.618923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 144/256] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:34:29 2022] DELETE /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:34:29.626855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9b17fb92-1b4f-4ade-bdc6-bc4ff279ddc1 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc591f99700>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:29.683408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9b17fb92-1b4f-4ade-bdc6-bc4ff279ddc1 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 200 len: 353 microversion: 2.1 time: 0.060174 Feb 16 05:34:29.683994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 145/257] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:34:29 2022] GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:29.792730 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:29.802059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0051fbd4-53e2-4cb8-a677-c889009617bb tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.492903 Feb 16 05:34:29.802641 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 113/258] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:29 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:30.021661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:30.022397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:30.032486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.033766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.033766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.035435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.108670 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-1e1ff6e0-7573-4dde-bac6-6c812a43dc7e req-e19ffb1a-ba1d-4f26-9c97-637548a40e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccde5a1c-d663-470c-bd84-5e48b988b2dd", "name": "network-vif-deleted", "tag": "0eac56b7-a543-4943-97d3-45cabe36a813"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:30.110568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:30.110568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:34:30.118531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1e1ff6e0-7573-4dde-bac6-6c812a43dc7e req-e19ffb1a-ba1d-4f26-9c97-637548a40e3d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.118978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1e1ff6e0-7573-4dde-bac6-6c812a43dc7e req-e19ffb1a-ba1d-4f26-9c97-637548a40e3d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.130061 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-1e1ff6e0-7573-4dde-bac6-6c812a43dc7e req-e19ffb1a-ba1d-4f26-9c97-637548a40e3d service nova] Creating event network-vif-deleted:0eac56b7-a543-4943-97d3-45cabe36a813 for instance ccde5a1c-d663-470c-bd84-5e48b988b2dd on hv-cinder-82947 Feb 16 05:34:30.135303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-1e1ff6e0-7573-4dde-bac6-6c812a43dc7e req-e19ffb1a-ba1d-4f26-9c97-637548a40e3d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 Feb 16 05:34:30.135912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 114/259] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:30.194597 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:30.202704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9fbb4437-a206-450d-b6d5-c5e5f8074400 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.184725 Feb 16 05:34:30.203282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 146/260] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:30 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:30.453928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:30.454851 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:30.461596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.462299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.463241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.463593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.499665 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.500121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.500572 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lazy-loading 'fault' on Instance uuid ccde5a1c-d663-470c-bd84-5e48b988b2dd {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:34:30.572545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:30.581008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-25dab7eb-f091-4511-8c9d-487d0de1ab7a tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 200 len: 1303 microversion: 2.1 time: 0.130400 Feb 16 05:34:30.581008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 115/261] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:30 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:30.695478 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-50f126cd-dec0-4e91-a452-42da680b25e9 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Calling method '.version_select at 0x7fc592008820>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:30.722521 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-50f126cd-dec0-4e91-a452-42da680b25e9 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] HTTP exception thrown: Volume 11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 could not be found. Feb 16 05:34:30.723227 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-50f126cd-dec0-4e91-a452-42da680b25e9 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] Returning 404 to user: Volume 11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:30.724137 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-50f126cd-dec0-4e91-a452-42da680b25e9 tempest-VolumesGetTestJSON-2003053121 tempest-VolumesGetTestJSON-2003053121-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10" status: 404 len: 109 microversion: 2.1 time: 0.032281 Feb 16 05:34:30.724763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 147/262] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:34:30 2022] GET /compute/v2.1/os-volumes/11ea3d0d-2ad5-446d-952a-5d2ba22f1d10 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:30.821453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:30.824552 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:30.836707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.837776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:30.838601 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:30.839191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:31.011355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:31.018056 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9383ecba-3abc-45fc-83be-8ba964c315da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.202447 Feb 16 05:34:31.021229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 116/263] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:30 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:31.227771 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:31.228398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:31.236437 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:31.236944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:31.238133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:31.238746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:31.398408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:31.406844 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-650c8502-1b28-4338-a38e-1219002dcf18 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.184258 Feb 16 05:34:31.407672 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 148/264] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:31 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:31.596806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:31.598135 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: ccde5a1c-d663-470c-bd84-5e48b988b2dd] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:31.604681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:31.605352 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:31.606137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:31.606568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:31.626876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] HTTP exception thrown: Instance ccde5a1c-d663-470c-bd84-5e48b988b2dd could not be found. Feb 16 05:34:31.627477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Returning 404 to user: Instance ccde5a1c-d663-470c-bd84-5e48b988b2dd could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:31.628467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-431f5597-2324-4317-9328-5f6b8c59e047 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd" status: 404 len: 111 microversion: 2.1 time: 0.035341 Feb 16 05:34:31.629350 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 117/265] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:31 2022] GET /compute/v2.1/servers/ccde5a1c-d663-470c-bd84-5e48b988b2dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:31.735175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1052148823", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "f5e569ac-f0e9-4164-95dc-8634b19a6e64"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:31.784766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] validate_networks() for [('f5e569ac-f0e9-4164-95dc-8634b19a6e64', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:34:32.033955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:32.034803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:32.041362 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.042103 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.043139 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.043673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.262619 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:34:32.263197 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:34:32.263919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:34:32.265083 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:34:32.266164 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:34:32.281754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.282205 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.283016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.283452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.326922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Getting quotas for project 434acd7d54a24e18a504c01b72599c36. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:34:32.332498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Getting quotas for user 7e792fde8d97434b95de7a9b58a41d14 and project 434acd7d54a24e18a504c01b72599c36. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:34:32.346504 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:32.356776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2e000869-917d-48de-acab-16c52a6ea16f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.326060 Feb 16 05:34:32.358346 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:34:32.365491 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:34:32.367275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 118/266] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:32 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:32.423707 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fd72c424-8c1f-43e1-9a82-2660e6b15bb6 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692512 Feb 16 05:34:32.424768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 149/267] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:34:32.426379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:32.427099 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:32.434576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.435912 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f432128b-4c81-428a-883d-7ba968f25cd0 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:32.436751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f432128b-4c81-428a-883d-7ba968f25cd0 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:32.437076 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.437916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:32.438357 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:32.504067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f432128b-4c81-428a-883d-7ba968f25cd0 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:32.511827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f432128b-4c81-428a-883d-7ba968f25cd0 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1214 microversion: 2.1 time: 0.080444 Feb 16 05:34:32.512589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 150/268] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:32 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:32.623978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:32.632400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1080e8ad-b260-4bcd-bb0a-2831e7916959 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.210130 Feb 16 05:34:32.633219 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 119/269] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:32 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:33.374812 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:33.375362 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:33.383419 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.383870 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.384644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.385080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.523361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:33.529201 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:33.530000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:33.536008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.536773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.536903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9e7e5471-5a96-42d1-847d-f9a927192afc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.161925 Feb 16 05:34:33.537876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.538211 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 151/270] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:33 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:33.538636 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.601191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:33.609905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-892da846-d0d1-474e-979a-b806d793b4fa tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1266 microversion: 2.1 time: 0.084324 Feb 16 05:34:33.610487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 120/271] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:33 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:33.649885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:33.650495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:33.656676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.657192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.657988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:33.658420 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:33.819538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:33.828638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d324097f-208b-4261-b57a-19f6f659ad85 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.182341 Feb 16 05:34:33.829774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 152/272] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:33 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:34.555679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:34.556944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:34.564802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.565233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:34.566136 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.566646 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:34.627474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:34.628081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:34.640104 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.640819 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:34.641838 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.642540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:34.781757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:34.789109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-af37e3a7-270b-43e6-8c49-476eed435f56 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.237522 Feb 16 05:34:34.799994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 121/273] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:34 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:34.846277 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:34.847008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:34.847508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:34.855754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.858290 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c365e4e7-1997-4579-9e50-c54b43275fef tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.234521 Feb 16 05:34:34.858743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:34.868017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 153/274] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:34 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:34.870068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:34.882173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:35.116905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:35.125746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6048b394-6c6b-49ab-aa0b-53b2db97f41f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.283542 Feb 16 05:34:35.136229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 122/275] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:34 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:35.446612 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-9a472e39-cb54-4043-a8d9-d683d92298a4 req-1b22a2f2-1187-4962-9611-ff6594f0e0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015eef3f-855a-46ba-bccf-d1d1b85d4791", "tag": "ad922db5-0607-41c5-a963-51c1ed30aaa8"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:35.450042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:35.450042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:35.469473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9a472e39-cb54-4043-a8d9-d683d92298a4 req-1b22a2f2-1187-4962-9611-ff6594f0e0ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:35.470103 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9a472e39-cb54-4043-a8d9-d683d92298a4 req-1b22a2f2-1187-4962-9611-ff6594f0e0ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:35.493044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-9a472e39-cb54-4043-a8d9-d683d92298a4 req-1b22a2f2-1187-4962-9611-ff6594f0e0ce service nova] Creating event network-changed:ad922db5-0607-41c5-a963-51c1ed30aaa8 for instance 015eef3f-855a-46ba-bccf-d1d1b85d4791 on hv-cinder-82947 Feb 16 05:34:35.502894 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-9a472e39-cb54-4043-a8d9-d683d92298a4 req-1b22a2f2-1187-4962-9611-ff6594f0e0ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060552 Feb 16 05:34:35.503507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 154/276] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:35.806000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:35.807669 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:35.814325 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:35.814853 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:35.815716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:35.816385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:35.876968 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:35.877714 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:35.885956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:35.886703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:35.887705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:35.888919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:36.074722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:36.088882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ddd4668b-afe0-4208-8843-db8f7d267d45 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.285866 Feb 16 05:34:36.090377 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 123/277] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:35 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:36.147650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:36.149893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:36.158880 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:36.171629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a3e5d405-bd58-4de4-97b3-dcc216388155 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.298514 Feb 16 05:34:36.172230 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 155/278] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:35 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:36.178398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:36.178854 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:36.181906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:36.182362 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:36.307940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-bc42cd17-84cc-439d-b627-a7be651dc467 req-21d5615a-c627-4dbf-a9da-18e7b9ce7906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a3cf44-4b52-472e-8e55-9209e88f127d", "name": "network-vif-plugged", "status": "completed", "tag": "1a2ee93b-aa41-40e5-b336-729f04e7e5c2"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:36.312115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:36.312115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:36.322769 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-bc42cd17-84cc-439d-b627-a7be651dc467 req-21d5615a-c627-4dbf-a9da-18e7b9ce7906 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:36.323321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-bc42cd17-84cc-439d-b627-a7be651dc467 req-21d5615a-c627-4dbf-a9da-18e7b9ce7906 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:36.343885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-bc42cd17-84cc-439d-b627-a7be651dc467 req-21d5615a-c627-4dbf-a9da-18e7b9ce7906 service nova] Creating event network-vif-plugged:1a2ee93b-aa41-40e5-b336-729f04e7e5c2 for instance 64a3cf44-4b52-472e-8e55-9209e88f127d on hv-cinder-82947 Feb 16 05:34:36.352168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-bc42cd17-84cc-439d-b627-a7be651dc467 req-21d5615a-c627-4dbf-a9da-18e7b9ce7906 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050627 Feb 16 05:34:36.353459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 156/279] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:36.512191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:36.521936 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-10a58660-4e15-4c56-8389-bf7547f9e0eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.383348 Feb 16 05:34:36.532931 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 124/280] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:36 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:37.109624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:37.111304 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:37.118490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.119032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.119897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.120406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.188470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:37.189085 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:37.195368 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.196154 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.196944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.197566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.332378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:37.340665 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-35bed524-22f1-4189-8e3e-2c8c7eea0cbe tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.236463 Feb 16 05:34:37.343730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 157/281] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:37 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:37.427596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:37.438862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-29dc7c91-641b-46f5-8824-6f7689af4ed4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.254801 Feb 16 05:34:37.439456 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 125/282] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:37 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:37.539349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:37.540063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:37.547263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.547785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.548569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:37.549002 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:37.692249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:37.699910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1928a89b-2db8-437c-a024-9a52ec671301 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.164127 Feb 16 05:34:37.700705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 158/283] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:37 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:38.366554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:38.367763 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:38.398176 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.398752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.399784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.400712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.458604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:38.459819 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:38.468194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.468657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.470480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.470920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.560546 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:38.575688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-eb6bc9ae-0378-4a03-bfcc-364945e6401f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1318 microversion: 2.1 time: 0.212221 Feb 16 05:34:38.576306 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 126/284] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:38 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:38.618133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:38.625373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0bb8ff6f-18d7-4717-9cee-87d519a5e643 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.173297 Feb 16 05:34:38.625941 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 159/285] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:38 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:38.716998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:38.717889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:38.723758 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.724216 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.725006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:38.725481 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:38.864360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:38.871515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a09c27f9-8bf5-49be-87e8-c0d3e5609af2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.158191 Feb 16 05:34:38.872091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 127/286] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:38 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:39.592582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:39.593203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:39.599744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.600194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:39.600983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.601449 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:39.642377 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:39.642930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:39.649625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.650080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:39.650937 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.651410 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:39.744345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:39.752399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ae6232fa-aef6-4970-84a5-c67ca9c3ecd3 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1509 microversion: 2.1 time: 0.164147 Feb 16 05:34:39.752985 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 160/287] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:39 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:39.792693 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:39.800264 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-dc5f3985-468b-4614-824a-0dc9fef96678 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.162132 Feb 16 05:34:39.800835 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 128/288] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:39 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:39.888859 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:39.889705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:39.895465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.895879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:39.896662 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:39.897101 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:40.045646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:40.053180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-09191c63-1c23-4f14-bc81-7a379ed93b8a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.168994 Feb 16 05:34:40.053823 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 161/289] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:39 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:40.816019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:40.816630 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:40.822922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:40.823364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:40.824140 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:40.824570 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:40.967078 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:40.974732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4886439c-fbdf-4573-9705-fa49c01d5971 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.162328 Feb 16 05:34:40.975296 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 129/290] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:40 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:41.071277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:41.072575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:41.073631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dfce279-2b99-4165-8c0b-80f8cb9e6d9b"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:41.074945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:41.080623 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:41.081473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:41.082333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:41.082457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:41.082748 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:41.083040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:41.083949 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:41.084433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:41.263805 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:41.271453 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e7a473b7-ccee-4254-9fa6-dfe6adf68929 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.204514 Feb 16 05:34:41.272260 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 162/291] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:41 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:41.991519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:41.992158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:41.998594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:41.999036 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:41.999811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:42.000243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:42.149677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:42.157772 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f6c77a2d-9b3e-4114-b5dd-3e90c20fd111 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.170001 Feb 16 05:34:42.158337 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 163/292] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:41 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:42.287498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:42.288130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:42.294009 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:42.294984 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:42.296005 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:42.296437 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:42.449133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:42.456611 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4f73f508-23eb-4452-8ce7-7bdab8c94019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.172581 Feb 16 05:34:42.457491 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 164/293] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:42 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:43.174754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:43.176050 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:43.182717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:43.183178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:43.183995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:43.184525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:43.406479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:43.413847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d50261f2-6d8e-447c-aae3-fd987c4ccf6f tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.242659 Feb 16 05:34:43.417322 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 165/294] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:43 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:43.475530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:43.476797 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:43.483867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:43.484318 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:43.485139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:43.485599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:43.641377 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:43.648817 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-05b458d2-3596-4e63-af32-ed264b89f46d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.177311 Feb 16 05:34:43.649397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 166/295] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:43 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:44.236690 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2f1fceee-5dbc-4c85-9638-d91c0a44dbc8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.166044 Feb 16 05:34:44.238194 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 130/296] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:34:41 2022] POST /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 194 bytes in 3169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:44.252295 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-0a9e4e41-16bc-4b6b-88d1-01a0f438ee7e req-9530eda7-9eb7-4698-9b34-91bcb171e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015eef3f-855a-46ba-bccf-d1d1b85d4791", "name": "network-vif-plugged", "status": "completed", "tag": "ad922db5-0607-41c5-a963-51c1ed30aaa8"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:44.255923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:44.255923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:44.267735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-0a9e4e41-16bc-4b6b-88d1-01a0f438ee7e req-9530eda7-9eb7-4698-9b34-91bcb171e6ad service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:44.268831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-0a9e4e41-16bc-4b6b-88d1-01a0f438ee7e req-9530eda7-9eb7-4698-9b34-91bcb171e6ad service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:44.284223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-0a9e4e41-16bc-4b6b-88d1-01a0f438ee7e req-9530eda7-9eb7-4698-9b34-91bcb171e6ad service nova] Creating event network-vif-plugged:ad922db5-0607-41c5-a963-51c1ed30aaa8 for instance 015eef3f-855a-46ba-bccf-d1d1b85d4791 on hv-cinder-82947 Feb 16 05:34:44.290705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-0a9e4e41-16bc-4b6b-88d1-01a0f438ee7e req-9530eda7-9eb7-4698-9b34-91bcb171e6ad service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043744 Feb 16 05:34:44.291321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 167/297] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:44.432434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:44.433468 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:44.446959 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:44.447569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:44.448752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:44.449880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:44.658096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:44.668135 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:44.669008 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:44.680999 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:44.681871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ec8226ec-7bac-494e-bbee-8e4b38628c5d tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.254083 Feb 16 05:34:44.682864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 131/298] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:44 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:44.683031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:44.684167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:44.684611 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:44.861935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:44.869101 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-003bf525-0420-4771-9010-5f8a27e198e3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.206685 Feb 16 05:34:44.869689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 168/299] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:44 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:45.698728 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:45.699361 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:45.706308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:45.706760 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:45.707545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:45.707982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:45.857802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:45.866288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-47621a81-f555-479d-b67c-5af296a73c3e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1314 microversion: 2.1 time: 0.171483 Feb 16 05:34:45.867309 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 132/300] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:45 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:45.887856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:45.889063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:45.895689 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:45.896152 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:45.897000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:45.897478 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:46.058624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:46.066665 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ae759740-9f64-46be-893e-0c1941c24cc5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.182529 Feb 16 05:34:46.067224 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 169/301] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:45 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:46.883831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:46.884473 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:46.891681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:46.892227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:46.893136 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:46.893604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.025071 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:47.032915 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f3c808b4-a902-4745-8981-5f51c0413d7e tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1497 microversion: 2.1 time: 0.153105 Feb 16 05:34:47.033504 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 133/302] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:46 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:47.082539 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:47.083143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:47.089325 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.089775 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.090576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.091001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.231202 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:47.238757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e8271874-093a-430b-82d5-bd9cceadcf1c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.159814 Feb 16 05:34:47.239329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 170/303] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:47 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:47.663650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:47.664132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:47.670908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.671542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.672495 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.673082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.703737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:34:47.790624 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-67cd9d7a-d2e5-4a38-a191-357db3084ee4 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "DELETE /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 204 len: 0 microversion: 2.1 time: 0.130312 Feb 16 05:34:47.791415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 134/304] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:34:47 2022] DELETE /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:34:47.799508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:47.800042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:47.817895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.817895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.817895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:47.817895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:47.961577 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:47.969177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-45b2e041-203b-4df2-a58d-f56c469648de tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1503 microversion: 2.1 time: 0.173491 Feb 16 05:34:47.969893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 171/305] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:47 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:48.256409 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:48.257088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:48.263286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:48.263733 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:48.264513 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:48.264943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:48.403882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:48.411142 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-aa84e9d6-445c-40c6-bfc2-925ed78dc949 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.158676 Feb 16 05:34:48.411684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 135/306] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:48 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:48.986624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:48.987235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:48.993522 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:48.993972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:48.994737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:48.995167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:49.139515 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:49.146840 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d55445c7-7cf4-4245-b551-c9913edea6c2 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1503 microversion: 2.1 time: 0.164490 Feb 16 05:34:49.147457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 172/307] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:48 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:49.427668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:49.428275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:49.434632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:49.435087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:49.435862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:49.436300 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:49.568542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:49.576767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-37de62de-b5be-4a36-bc69-8d6c5bd74e06 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.152685 Feb 16 05:34:49.577376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 136/308] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:49 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:50.163961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:50.164578 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:50.171434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:50.171887 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:50.172667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:50.173099 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:50.312332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:50.319701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-75408626-60b4-4f5b-8312-9eba1f20d70c tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1503 microversion: 2.1 time: 0.159550 Feb 16 05:34:50.320280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 173/309] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:50 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:50.594502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:50.595145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:50.601767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:50.602209 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:50.603005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:50.603437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:50.919434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-26fbd70f-866a-4163-b848-79391762d18d req-0f925902-1203-457c-a982-f72a6d31e635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015eef3f-855a-46ba-bccf-d1d1b85d4791", "name": "network-vif-deleted", "tag": "ad922db5-0607-41c5-a963-51c1ed30aaa8"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:50.921534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:34:50.921534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:34:50.930974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-26fbd70f-866a-4163-b848-79391762d18d req-0f925902-1203-457c-a982-f72a6d31e635 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:50.931685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-26fbd70f-866a-4163-b848-79391762d18d req-0f925902-1203-457c-a982-f72a6d31e635 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:50.939981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:50.943367 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-26fbd70f-866a-4163-b848-79391762d18d req-0f925902-1203-457c-a982-f72a6d31e635 service nova] Creating event network-vif-deleted:ad922db5-0607-41c5-a963-51c1ed30aaa8 for instance 015eef3f-855a-46ba-bccf-d1d1b85d4791 on hv-cinder-82947 Feb 16 05:34:50.947777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-90eedc3a-1320-4acc-a118-d166fd296db2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.357487 Feb 16 05:34:50.948145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-26fbd70f-866a-4163-b848-79391762d18d req-0f925902-1203-457c-a982-f72a6d31e635 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Feb 16 05:34:50.948365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 137/310] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:50 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:50.948727 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 174/311] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:34:51.337619 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:51.338470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:51.344535 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:51.345082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:51.345771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:51.346196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:51.380889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:51.381376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:51.381855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lazy-loading 'fault' on Instance uuid 015eef3f-855a-46ba-bccf-d1d1b85d4791 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:34:51.425713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e792fde8d97434b95de7a9b58a41d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434acd7d54a24e18a504c01b72599c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:51.435082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c1b5bd5e-9012-400b-97eb-588b694e1fc7 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 200 len: 1304 microversion: 2.1 time: 0.101624 Feb 16 05:34:51.435980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 138/312] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:51 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:51.967346 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:51.967940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:51.973874 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:51.974315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:51.975079 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:51.975506 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:52.116298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:52.124235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-592f2433-9d82-4ca3-a063-10ee72f6b897 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.161969 Feb 16 05:34:52.124828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 175/313] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:51 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:52.452332 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:52.452957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] [instance: 015eef3f-855a-46ba-bccf-d1d1b85d4791] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:52.459133 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:52.459579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:52.460348 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:52.460777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:52.473862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] HTTP exception thrown: Instance 015eef3f-855a-46ba-bccf-d1d1b85d4791 could not be found. Feb 16 05:34:52.474449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] Returning 404 to user: Instance 015eef3f-855a-46ba-bccf-d1d1b85d4791 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:52.475259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5c8c7be7-1d7d-4d56-9708-11182ed31372 tempest-VolumesActionsTest-502572532 tempest-VolumesActionsTest-502572532-project] 10.222.0.75 "GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791" status: 404 len: 111 microversion: 2.1 time: 0.027180 Feb 16 05:34:52.475832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 139/314] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:52 2022] GET /compute/v2.1/servers/015eef3f-855a-46ba-bccf-d1d1b85d4791 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:34:53.145362 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:53.146450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:53.153122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:53.154337 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:53.155141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:53.155574 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:53.287514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:53.295635 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-85aada79-55dc-479e-9387-51984be6f345 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.157206 Feb 16 05:34:53.296209 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 176/315] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:53 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:54.312707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:54.313345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:54.319453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:54.319897 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:54.320662 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:54.321093 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:54.449044 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:54.456313 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e67355ed-f3db-486a-b007-903b1b3b0f91 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.147891 Feb 16 05:34:54.456882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 140/316] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:54 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:55.472396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:55.472934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:55.479144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:55.479587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:55.480350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:55.480783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:55.613561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:55.621174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2525fdce-a92c-4c6a-b149-5318cb073e53 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1520 microversion: 2.1 time: 0.152398 Feb 16 05:34:55.621863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 177/317] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:55 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:34:55.930290 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dfce279-2b99-4165-8c0b-80f8cb9e6d9b"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:34:55.931406 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:55.938613 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:55.939068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:55.939855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:55.940325 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.014796 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Invalid volume: volume 3dfce279-2b99-4165-8c0b-80f8cb9e6d9b is already attached to instances: 64a3cf44-4b52-472e-8e55-9209e88f127d Feb 16 05:34:56.015400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 400 to user: Invalid volume: volume 3dfce279-2b99-4165-8c0b-80f8cb9e6d9b is already attached to instances: 64a3cf44-4b52-472e-8e55-9209e88f127d {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:34:56.016233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-77906afd-2afb-49aa-ad18-52830a26251f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089815 Feb 16 05:34:56.016797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 141/318] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:34:55 2022] POST /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:34:56.075163 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:56.075679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:56.081842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.082215 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.083053 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.083487 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.204196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lazy-loading 'services' on Instance uuid 64a3cf44-4b52-472e-8e55-9209e88f127d {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:34:56.315492 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-aa0aad9c-e32a-452b-8ed3-12425ca3c4dc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments/3dfce279-2b99-4165-8c0b-80f8cb9e6d9b" status: 202 len: 0 microversion: 2.1 time: 0.243892 Feb 16 05:34:56.316076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 178/319] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:34:56 2022] DELETE /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments/3dfce279-2b99-4165-8c0b-80f8cb9e6d9b => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:34:56.324089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:56.325006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:56.331731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.332238 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.332964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.333432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.362319 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ece8fe31-1799-49b2-ab96-8758569f897a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Feb 16 05:34:56.362872 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 142/320] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:56 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:56.639457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:56.640065 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:56.646547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.646993 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.647762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.648199 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.783432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:56.790696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-79e19f6d-fe21-4a80-9f4c-ef78de4c6852 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1500 microversion: 2.1 time: 0.155904 Feb 16 05:34:56.791268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 179/321] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:56 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:56.806384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:56.806997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:56.812652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.813106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.813919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:56.814359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:56.942582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:34:56.949770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-24d8abbc-37fc-43bd-91dd-5899704a0a8d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1514 microversion: 2.1 time: 0.146957 Feb 16 05:34:56.950340 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 143/322] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:34:56 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:34:57.373906 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:57.374879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:57.380594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:57.381042 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:57.381847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:57.382282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:57.410112 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-34c75266-abf6-4bd9-8457-168cde4151b8 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040470 Feb 16 05:34:57.410590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 180/323] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:57 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:58.421027 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:58.422028 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:58.428266 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:58.428713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:58.429514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:58.429955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:58.459418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4558b6ce-9101-4df8-b8bc-81ad7980e242 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Feb 16 05:34:58.459970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 144/324] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:58 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:34:59.470983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:34:59.471884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:34:59.478043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:59.478490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:59.479278 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:34:59.479704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:34:59.510784 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c492019f-914a-4659-ad3c-60d7113ce328 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Feb 16 05:34:59.511327 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 181/325] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:34:59 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:00.521382 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:00.522298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:00.528433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:00.529545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:00.530321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:00.530761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:00.560373 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2c12918c-c564-46ec-9844-daf0065e2c48 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Feb 16 05:35:00.560948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 145/326] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:00 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:01.424081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:01.425501 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:01.432012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.432463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.433490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.433911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.460468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lazy-loading 'flavor' on Instance uuid 032cece1-a548-4e1f-a72a-b3647d09718c {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:35:01.539197 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b7695489-736c-4c1c-b123-24663ada9afd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action" status: 200 len: 32 microversion: 2.1 time: 0.120687 Feb 16 05:35:01.541054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 182/327] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:35:01 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action => generated 32 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:35:01.552694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:01.553345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:01.561292 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.561843 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.562619 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.563115 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.578659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:01.579110 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:01.585690 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.586147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.586940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:01.587488 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:01.660139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-505a066b-3bef-45b9-b906-401eb347c369 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091363 Feb 16 05:35:01.660717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 183/328] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:01 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:35:01.897727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:01.925128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-aec9b3aa-d16a-4417-a89a-9affe0e2f53e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.377986 Feb 16 05:35:01.927048 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 146/329] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:01 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:02.671639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:02.672552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:02.678831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:02.679343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:02.680255 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:02.680605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:02.710994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c0aa4104-c71d-43c4-b624-01a6f8d02114 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043311 Feb 16 05:35:02.711712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 184/330] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:02 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:35:02.879771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-869791325", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "8cb1fb16-d79c-49c4-8a9e-84b03bfe3409"}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:02.942713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:02.943609 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:02.946830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] validate_networks() for [('8cb1fb16-d79c-49c4-8a9e-84b03bfe3409', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:35:02.950178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:02.952473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:02.953385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:02.954173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:03.106765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:03.116319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cb75b5b0-0f58-4c15-a246-a307d31bdf72 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.177489 Feb 16 05:35:03.117902 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 185/331] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:02 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:03.401622 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:35:03.402058 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:35:03.402828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:35:03.402926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:35:03.403333 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:35:03.413674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:03.414130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:03.415124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:03.415569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:03.435649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:35:03.440114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Getting quotas for user 65045a2a88084c12aeb9133bf0162193 and project 1050764769f2439fae8ad76e27663aec. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:35:03.451500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:35:03.453846 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:35:03.562686 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-18fc0672-aafc-4fb9-8693-d4f43f6fb97d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686563 Feb 16 05:35:03.565419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 147/332] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:35:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:35:03.573103 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bc3bdff3-1468-4d92-8ac9-93e0f86fed15 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:03.573744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bc3bdff3-1468-4d92-8ac9-93e0f86fed15 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:03.632679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bc3bdff3-1468-4d92-8ac9-93e0f86fed15 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:03.639299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bc3bdff3-1468-4d92-8ac9-93e0f86fed15 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1217 microversion: 2.1 time: 0.069841 Feb 16 05:35:03.648554 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 186/333] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:03 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:04.134891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:04.136277 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:04.144681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:04.145602 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:04.146943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:04.147702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:04.312729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:04.321441 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6d0b84aa-9fcc-4654-993d-ecc732b7357f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.190666 Feb 16 05:35:04.322149 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 148/334] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:04 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:04.656393 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:04.657005 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:04.663717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:04.664480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:04.665558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:04.666217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:04.733359 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:04.750642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5a4dc875-8abd-4946-9a9d-372753f4a42e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1221 microversion: 2.1 time: 0.098477 Feb 16 05:35:04.751654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 187/335] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:04 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:05.339310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:05.340087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:05.347310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:05.347875 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:05.348783 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:05.349319 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:05.506358 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:05.514407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-86ada2da-32ce-40e1-aeda-38901629b141 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.178771 Feb 16 05:35:05.515551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 149/336] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:05 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:05.768377 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:05.769170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:05.777052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:05.777591 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:05.779245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:05.779919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:05.864824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:05.873609 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-465d113a-44c3-4821-8daf-a773ec084c53 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1221 microversion: 2.1 time: 0.109078 Feb 16 05:35:05.874781 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 188/337] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:05 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:06.532981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:06.534275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:06.549376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:06.549980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:06.550815 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:06.551258 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:06.709132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:06.730894 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-98d4856a-10d7-4b65-8b53-463071f64523 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.202998 Feb 16 05:35:06.735585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 150/338] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:06 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:06.894303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:06.896384 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:06.908255 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:06.908967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:06.910132 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:06.912848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:07.003735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:07.020771 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eb781ad6-3a7f-4e13-9111-5f7bfce4717e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1287 microversion: 2.1 time: 0.124374 Feb 16 05:35:07.034955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 189/339] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:06 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:07.751926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:07.752501 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:07.759316 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:07.759895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:07.760554 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:07.760995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:08.041301 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:08.041885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:08.055341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:08.055800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:08.056638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:08.057081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:08.142811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:08.150689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2dfc588a-3ddb-47cd-9a1e-8db3c8dcb354 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.402545 Feb 16 05:35:08.162957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 151/340] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:07 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:08.217361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:08.224650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-824b5031-913f-49e2-9389-d19d3d154589 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.187227 Feb 16 05:35:08.225228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 190/341] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:08 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:08.560674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-345811f1-2074-4fd8-b3cb-cb743a40b9e2 req-e5290df0-9415-43ca-b599-583aba080d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e669e6a-26fc-48ca-be5b-b4f882ba61de", "tag": "973b69b7-1831-4e77-9b05-2bae4a584505"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:08.564726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:08.564726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:08.578539 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-345811f1-2074-4fd8-b3cb-cb743a40b9e2 req-e5290df0-9415-43ca-b599-583aba080d2c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:08.579617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-345811f1-2074-4fd8-b3cb-cb743a40b9e2 req-e5290df0-9415-43ca-b599-583aba080d2c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:08.629213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-345811f1-2074-4fd8-b3cb-cb743a40b9e2 req-e5290df0-9415-43ca-b599-583aba080d2c service nova] Creating event network-changed:973b69b7-1831-4e77-9b05-2bae4a584505 for instance 0e669e6a-26fc-48ca-be5b-b4f882ba61de on hv-cinder-82947 Feb 16 05:35:08.629213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-345811f1-2074-4fd8-b3cb-cb743a40b9e2 req-e5290df0-9415-43ca-b599-583aba080d2c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069374 Feb 16 05:35:08.629213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 152/342] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:35:09.170693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:09.171947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:09.184348 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:09.191126 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:09.192365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:09.193166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:09.242527 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:09.243308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:09.256406 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:09.257841 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:09.260838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:09.261534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:09.582783 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:09.590553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f3886441-d998-4ab7-a49c-e0ef1ba65743 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.352163 Feb 16 05:35:09.594957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 153/343] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:09 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:09.613171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:09.623936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6e000d55-4bc5-4f09-ae26-37dab93676bc tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.457616 Feb 16 05:35:09.626208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 191/344] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:09 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:10.611945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:10.612561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:10.619055 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:10.620092 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:10.620909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:10.621547 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:10.645663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:10.647423 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:10.655680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:10.656439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:10.657527 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:10.658192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:10.776010 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:10.790020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-de6d30d2-aff5-4db6-834f-269cb99f3b42 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.181373 Feb 16 05:35:10.791032 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 154/345] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:10 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:10.830459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:10.839584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-150b5cb1-cefb-4807-99a9-2ed14a5a895d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.199182 Feb 16 05:35:10.840862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 192/346] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:10 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:11.807189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:11.807919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:11.814426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:11.814878 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:11.815657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:11.816097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:11.856262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:11.856999 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:11.863627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:11.864176 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:11.865172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:11.865822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:11.995604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:12.004259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7ae2c94e-e242-41da-ba8e-bff07a019d34 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.200734 Feb 16 05:35:12.004855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 155/347] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:11 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:12.032605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:12.042565 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9a439e77-c474-4a01-a92d-8b648ce0e6c4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.189899 Feb 16 05:35:12.043175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 193/348] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:11 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:13.021613 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:13.022882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:13.031263 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:13.031757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:13.032563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:13.033007 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:13.060834 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:13.062092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:13.068710 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:13.069143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:13.069950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:13.070382 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:13.180166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:13.187855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c0c3f194-c3e8-4780-b9c7-8ae38f0eeeb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.169939 Feb 16 05:35:13.190009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 156/349] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:13 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:13.247217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:13.254896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3e6d9c3f-8012-4c25-8d76-40d8071cd0b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.197598 Feb 16 05:35:13.255457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 194/350] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:13 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:14.206055 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:14.206884 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:14.213355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:14.213868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:14.214876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:14.215323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:14.273639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:14.274434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:14.282080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:14.283216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:14.284712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:14.286201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:14.362560 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:14.371104 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-28cbdd7a-c1f2-41e9-893a-746f468f022b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.168734 Feb 16 05:35:14.385220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 157/351] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:14 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:14.456313 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:14.466601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0137b489-9dc6-4a53-9237-ece0e769ce20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.196408 Feb 16 05:35:14.468615 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 195/352] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:14 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:15.391324 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:15.392548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:15.401813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:15.402328 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:15.403392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:15.403826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:15.486525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:15.487452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:15.494892 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:15.495669 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:15.496448 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:15.497059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:15.566466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:15.573735 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9b2e0556-b43f-4ac3-8f63-2712fbe4450e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.188868 Feb 16 05:35:15.574475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 158/353] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:15 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:15.653593 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:15.661975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ad14f7a2-8dba-4d22-b85e-956b05914b16 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.179895 Feb 16 05:35:15.672827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 196/354] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:15 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:16.591002 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:16.591771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:16.598664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:16.599115 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:16.599893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:16.600331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:16.679675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:16.680314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:16.687126 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:16.687551 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:16.688757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:16.689209 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:16.745308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:16.755745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ca29d4cc-3ec6-4fec-9997-cd426b354212 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.168387 Feb 16 05:35:16.756607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 159/355] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:16 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:16.838742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:16.846262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7e37f387-00f9-47aa-b9f5-92643d499fcd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.170365 Feb 16 05:35:16.846765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 197/356] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:16 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:17.293792 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a86afd52-602d-4c30-a0ac-1060bb575323"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:17.295120 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:17.301785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.302297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.303099 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.303542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.633852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e5ba6443-a363-4a84-b395-0c19ce0eb55e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343636 Feb 16 05:35:17.640750 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 160/357] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:35:17 2022] POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:17.647429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-9d6f91f4-d94f-4a95-8580-0b5fa3ff478a req-98b667ff-227e-4dd8-81ec-7d3af217ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e669e6a-26fc-48ca-be5b-b4f882ba61de", "name": "network-vif-plugged", "status": "completed", "tag": "973b69b7-1831-4e77-9b05-2bae4a584505"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:17.649343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:17.649343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:35:17.659271 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9d6f91f4-d94f-4a95-8580-0b5fa3ff478a req-98b667ff-227e-4dd8-81ec-7d3af217ca5a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.660053 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9d6f91f4-d94f-4a95-8580-0b5fa3ff478a req-98b667ff-227e-4dd8-81ec-7d3af217ca5a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.679032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-9d6f91f4-d94f-4a95-8580-0b5fa3ff478a req-98b667ff-227e-4dd8-81ec-7d3af217ca5a service nova] Creating event network-vif-plugged:973b69b7-1831-4e77-9b05-2bae4a584505 for instance 0e669e6a-26fc-48ca-be5b-b4f882ba61de on hv-cinder-82947 Feb 16 05:35:17.685060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-9d6f91f4-d94f-4a95-8580-0b5fa3ff478a req-98b667ff-227e-4dd8-81ec-7d3af217ca5a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041130 Feb 16 05:35:17.687115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 198/358] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:17.773372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:17.774262 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:17.783109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.783806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.790509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.791173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.863691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:17.864584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:17.873422 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.874338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.875453 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:17.876052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:17.999203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:18.020718 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-00907547-57c7-42c4-84a6-5a23ec332b14 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.251191 Feb 16 05:35:18.030558 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 161/359] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:17 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:18.073023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:18.080810 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a3f2eb28-45b5-4cc6-b556-cdf1677847ef tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.221398 Feb 16 05:35:18.081666 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 199/360] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:17 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:19.038773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:19.039493 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:19.046463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:19.046935 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:19.047791 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:19.048232 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:19.099506 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:19.100721 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:19.107270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:19.107922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:19.109759 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:19.110348 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:19.228749 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:19.239240 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c903352c-b1b4-4670-aaeb-cfc609692513 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1317 microversion: 2.1 time: 0.205395 Feb 16 05:35:19.239753 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 162/361] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:19 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:19.257986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:19.268451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cb1cc2cd-0b29-421e-8f9e-40b0ad807b41 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.173007 Feb 16 05:35:19.276098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 200/362] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:19 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:20.261844 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:20.263384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:20.282066 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:20.282704 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:20.283710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:20.284641 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:20.293286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:20.294312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:20.327332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:20.335020 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:20.339610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:20.340286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:20.580646 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:20.594081 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1a627ca7-05d4-41cd-9988-b8c84ee4b68d tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1507 microversion: 2.1 time: 0.336456 Feb 16 05:35:20.597247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 163/363] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:20 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:20.632402 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:20.639875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b47648bb-0363-4c62-9b58-9f9100e251c2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.351779 Feb 16 05:35:20.640442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 201/364] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:20 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:21.656257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:21.657509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:21.663985 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:21.670145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:21.674203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:21.674657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:21.824087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:21.832236 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4c836635-3edb-4e57-a6d9-fcaf3d828fd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.180271 Feb 16 05:35:21.833186 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 164/365] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:21 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:21.935729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9378184b-f860-4827-bd4f-020502755161"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:21.938429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:21.946125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:21.946826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:21.947784 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:21.948377 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:22.287971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ceadb010-34e2-4677-9e63-9d93fa93a1da tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "POST /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356849 Feb 16 05:35:22.288925 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 202/366] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:35:21 2022] POST /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:22.849453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:22.850067 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:22.857859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:22.859270 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:22.860428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:22.861128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:23.016265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:23.035544 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6394ec96-ac58-45d6-b39b-98e886979b5b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.190016 Feb 16 05:35:23.037026 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 165/367] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:22 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:24.055272 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:24.056221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:24.066757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:24.067461 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:24.068380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:24.068683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:24.261022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:24.269147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-12f82b96-c479-4045-b6aa-72e3ddb4c53c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.218291 Feb 16 05:35:24.278612 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 203/368] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:24 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:25.180258 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:25.180788 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:25.187557 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:25.188003 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:25.188769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:25.189198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:25.211543 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lazy-loading 'flavor' on Instance uuid 03664210-52cd-4649-abb9-282e98802be3 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:35:25.285380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:25.285987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:25.292392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:25.292977 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:25.293822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:25.294262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:25.442889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:25.450153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-05987cfe-340c-41b7-920a-1aca9090c24b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.168377 Feb 16 05:35:25.450721 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 204/369] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:25 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:25.896492 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1328619859", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "004f2655-6cbe-4c49-9f60-896ff03daa11"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:30.163293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] validate_networks() for [('004f2655-6cbe-4c49-9f60-896ff03daa11', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:35:30.290107 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-95143c35-f00f-43d9-a1d2-7db11d9a4aa9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/action" status: 202 len: 0 microversion: 2.20 time: 5.113542 Feb 16 05:35:30.291021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 166/370] 10.222.0.75 () {62 vars in 1318 bytes} [Wed Feb 16 05:35:25 2022] POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/action => generated 0 bytes in 5115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:35:30.296271 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a1d5a86a-5e98-488c-9eb0-bdfc9910cbc7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:30.303043 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a1d5a86a-5e98-488c-9eb0-bdfc9910cbc7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.303499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a1d5a86a-5e98-488c-9eb0-bdfc9910cbc7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.368436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a1d5a86a-5e98-488c-9eb0-bdfc9910cbc7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Going to try to stop instance {{(pid=122879) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 16 05:35:30.410964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a1d5a86a-5e98-488c-9eb0-bdfc9910cbc7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action" status: 202 len: 0 microversion: 2.1 time: 0.118416 Feb 16 05:35:30.411609 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 167/371] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:35:30 2022] POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:35:30.416497 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:30.417323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:30.424311 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.424764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.425593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.426029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.506901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:35:30.507319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:35:30.507780 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:35:30.508201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:35:30.508602 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:35:30.517533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.517972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.518948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.519378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.535620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Getting quotas for project a642dcc1cb8a4c1bbd3b1450e060c74c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:35:30.539445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Getting quotas for user ae34f18423784b6d9e9bd45f2fa796e2 and project a642dcc1cb8a4c1bbd3b1450e060c74c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:35:30.551156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:35:30.553477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:35:30.571160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.585524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c417d175-dee9-4434-93b3-3ab54235d609 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.172652 Feb 16 05:35:30.586115 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 168/372] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:30 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:30.590463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:30.591252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:30.599018 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0395f21b-530b-419c-92b6-e39a3c625bec tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.706153 Feb 16 05:35:30.600158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 205/373] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 16 05:35:30.604845 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:30.605662 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:30.611785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.612431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.613431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.613938 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.614908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.615352 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.616159 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:30.616807 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:30.759525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.769188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-222ba747-608b-4b47-b309-1a27a9a23949 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.167803 Feb 16 05:35:30.771918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 206/374] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:30 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:30.788555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.790428 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-032bb5d6-b863-4181-866a-4cf4e3b4da50 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:30.791485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-032bb5d6-b863-4181-866a-4cf4e3b4da50 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:30.798805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.800483 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.801776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-eed8baed-4e69-42d2-be60-3ed5c5fb1387 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.214629 Feb 16 05:35:30.802512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 169/375] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:30 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:30.863820 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-032bb5d6-b863-4181-866a-4cf4e3b4da50 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:30.871259 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-032bb5d6-b863-4181-866a-4cf4e3b4da50 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1219 microversion: 2.1 time: 0.089476 Feb 16 05:35:30.871958 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 207/376] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:30 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:31.602721 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:31.603336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:31.609906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.612973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.613827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.614274 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.768932 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:31.777088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cf27c4fd-c474-4e5e-991d-ac4d9d6e5eb7 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.177889 Feb 16 05:35:31.777697 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 170/377] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:31 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:31.791398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:31.792012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:31.798603 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.799050 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.799837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.800279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.839983 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:31.840824 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:31.850976 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.851738 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.852776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:31.853420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:31.966479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:31.974772 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-440167cb-a873-44e2-8488-3cfd765c915b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.186972 Feb 16 05:35:31.975354 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 208/378] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:31 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:31.985614 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:31.986562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:32.003294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:32.006872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:32.007940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:32.008533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:32.083854 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:32.091979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:32.096873 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:32.102706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f22592e9-3569-48d6-ba65-47dec6a313ad tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.278524 Feb 16 05:35:32.114037 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 171/379] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:31 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:32.114818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:32.114818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7ef8469b-3238-48b3-8199-dd0e240d8ab0 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1279 microversion: 2.1 time: 0.137050 Feb 16 05:35:32.114818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 209/380] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:31 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:32.794083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:32.795032 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:32.802110 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:32.802563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:32.803538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:32.803974 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:32.991781 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:32.992768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:33.000421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.000983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.001886 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.002392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.021342 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.028831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8c420a02-77a5-4842-9690-0c715058ae2e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.238397 Feb 16 05:35:33.039528 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 172/381] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:32 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:33.122070 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:33.122679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:33.129913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.130361 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.131146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.131582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.288777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.298597 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-491872bf-9da2-4e8e-ad0c-0d87a45e080f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.310445 Feb 16 05:35:33.299481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 210/382] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:32 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:33.303885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:33.304595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:33.310992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.311541 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.313089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.314090 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.413626 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.430210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.438795 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.442070 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2811e62f-b4a8-4a68-9cc9-16a2312d0c01 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.324036 Feb 16 05:35:33.442651 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 173/383] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:33 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:33.485755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:33.493198 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-370f4f8e-13cc-4ed2-836a-2ab79ada4ce5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.192662 Feb 16 05:35:33.493886 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 211/384] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:33 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:33.877090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-feea4a06-19c5-42ce-a8ab-62b845929424 req-2475594b-7ad7-4856-9125-33f1d4251d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc32bbc-43a6-4be6-91fb-c186a02af50c", "tag": "325b6ba7-382f-4677-8261-a77bd7a69aef"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:33.878813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:33.878813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:33.887190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-feea4a06-19c5-42ce-a8ab-62b845929424 req-2475594b-7ad7-4856-9125-33f1d4251d80 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:33.887862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-feea4a06-19c5-42ce-a8ab-62b845929424 req-2475594b-7ad7-4856-9125-33f1d4251d80 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:33.914817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-feea4a06-19c5-42ce-a8ab-62b845929424 req-2475594b-7ad7-4856-9125-33f1d4251d80 service nova] Creating event network-changed:325b6ba7-382f-4677-8261-a77bd7a69aef for instance adc32bbc-43a6-4be6-91fb-c186a02af50c on hv-cinder-82947 Feb 16 05:35:33.919889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-feea4a06-19c5-42ce-a8ab-62b845929424 req-2475594b-7ad7-4856-9125-33f1d4251d80 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046258 Feb 16 05:35:33.924046 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 174/385] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:35:34.047383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.048111 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.058182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.059737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.063151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.063606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.271737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.272698 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.279985 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.280464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.282075 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.282516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.373156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lazy-loading 'services' on Instance uuid 0e669e6a-26fc-48ca-be5b-b4f882ba61de {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:35:34.466253 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-08ee402a-a2a7-48b6-b929-9c17a9ce536b tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments/9378184b-f860-4827-bd4f-020502755161" status: 202 len: 0 microversion: 2.1 time: 0.199454 Feb 16 05:35:34.467755 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 175/386] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:35:34 2022] DELETE /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments/9378184b-f860-4827-bd4f-020502755161 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:35:34.475599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.476625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.485454 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.486295 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.487955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.488591 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.558305 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:34.576085 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5c88e6b0-b62d-4f7c-b35a-476911310115 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.533428 Feb 16 05:35:34.588319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 212/387] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:34 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:34.594911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.596115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.603549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.604642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.605715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.606332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.671088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:34.680647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4396940f-5449-4047-acce-b938cd54f8c2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.210661 Feb 16 05:35:34.681228 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 176/388] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:34 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:34.690006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.690983 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.698301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.698754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.699571 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.700035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.744466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9b77b27f-dd4b-47a4-9b4f-28e569793f02 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062090 Feb 16 05:35:34.745857 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 177/389] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:34 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:34.754839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:34.755502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:34.761710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.762287 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.763084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:34.763512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:34.803315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:34.817755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:34.819854 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:34.821498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5d206f67-9299-466b-bbd1-f006c585df5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.231859 Feb 16 05:35:34.822429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 213/390] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:34 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:35.007476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:35.014680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1f9fa4c0-8914-42b9-bf1d-8b265231750d tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.263525 Feb 16 05:35:35.015864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 178/391] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:34 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:35.593752 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:35.594368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.600858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.601373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.602144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.602579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.699419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:35.700368 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.710267 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.710720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.711516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.711950 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.748312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:35.756637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9e47be7e-7d06-4119-954f-301aa02b9e23 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1500 microversion: 2.1 time: 0.166702 Feb 16 05:35:35.757225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 214/392] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:35 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:35.761855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:35.762825 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.769535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.769985 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.770848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.771281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.800847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f8473627-6005-4de8-92e5-c40a9cfcbcb5 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Feb 16 05:35:35.801754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 215/393] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:35 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:35.806270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d6187a7-8ca1-4c73-8f60-1a51bb881576"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:35.807232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.813519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.813967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.814746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.815179 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.838514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] HTTP exception thrown: Cannot 'attach_volume' instance 032cece1-a548-4e1f-a72a-b3647d09718c while it is in vm_state rescued Feb 16 05:35:35.839105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Returning 409 to user: Cannot 'attach_volume' instance 032cece1-a548-4e1f-a72a-b3647d09718c while it is in vm_state rescued {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:35:35.839936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a78f7fb4-0d14-444f-9398-6f8f3198b136 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037211 Feb 16 05:35:35.840632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 216/394] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:35:35 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 16 05:35:35.847834 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:35.848436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.852447 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:35.854248 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.854699 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.855475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.855911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.860414 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-222de272-3c26-48a9-8666-4475b4359078 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.165818 Feb 16 05:35:35.860987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 179/395] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:35 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:35.865445 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:35.865944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.871599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.872301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.872833 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.873288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.946867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c0445890-f278-4c4b-8cbd-f6f80612d614 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action" status: 202 len: 0 microversion: 2.1 time: 0.084624 Feb 16 05:35:35.947521 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 180/396] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:35:35 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:35:35.961459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:35.962237 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:35.969648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.970100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.970892 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:35.971348 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:35.994707 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:36.003262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:36.004869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:36.006055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d9e7c375-a6f1-480f-b562-e41814eb0ed7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.163362 Feb 16 05:35:36.006604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 217/397] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:35 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:36.032509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:36.033122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:36.039081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.039536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:36.040682 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.040798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:36.155623 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:36.164379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-72c9bd6f-393b-402a-af18-96277b90280b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1508 microversion: 2.1 time: 0.210526 Feb 16 05:35:36.165039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 181/398] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:35 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:36.173974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:36.181225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-23f9a31e-985f-4019-89cd-ffaae6995734 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.153556 Feb 16 05:35:36.181816 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 218/399] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:36 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:36.812412 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:36.813402 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:36.819263 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.819710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:36.820488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.820911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:36.851773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-dd3bdd1e-db66-4b14-8a16-5486d51cdce6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043001 Feb 16 05:35:36.852253 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 182/400] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:35:36 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:35:36.877007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:36.877676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:36.883856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.884308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:36.885090 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:36.885552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.023921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:37.024532 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:37.031579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.032030 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.032596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.032822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.033281 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.040798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-911c6a03-0753-466c-bc6c-0f088cc814d2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.167367 Feb 16 05:35:37.041397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 219/401] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:36 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:37.173227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.181723 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.181919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:37.182490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:37.183476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.184645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-659ff325-a0bb-4205-8973-d7c3814407c3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.164595 Feb 16 05:35:37.185555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 183/402] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:37 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:37.189168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.189677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.193286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.193286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.199362 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:37.199981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:37.206130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.206574 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.207383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:37.207809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:37.354779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.361467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:37.362668 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0d3b80e6-8067-4687-ba07-65adf1ef13b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1508 microversion: 2.1 time: 0.184594 Feb 16 05:35:37.363324 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 220/403] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:37 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:37.368874 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f45dc537-a929-4908-aea0-3e87720e2e4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.173784 Feb 16 05:35:37.369418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 184/404] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:37 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:38.037710 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.038245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.045220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.045765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.047260 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.047788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.058713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.059457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.066063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.066515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.067306 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.067742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.075647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:35:38.153301 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-05ca4afc-d83d-4170-8b86-d57a03fb527e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 204 len: 0 microversion: 2.1 time: 0.118839 Feb 16 05:35:38.154225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 221/405] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:35:38 2022] DELETE /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:35:38.166758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.167620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.174222 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.174680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.175481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.175921 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.211151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.220378 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-26d75666-8cd9-40d8-883d-754089e59046 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.165193 Feb 16 05:35:38.220972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 185/406] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:38 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:38.227716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.228496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.235307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.235841 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.236703 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.237212 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.318761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.326363 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-afbad99a-6381-4c4d-9802-2e85c9d441bd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1513 microversion: 2.1 time: 0.164178 Feb 16 05:35:38.327066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 222/407] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:38 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:38.380080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.380938 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.390585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.394172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.394629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.395648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.395930 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.408101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.409853 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.411125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-49b36e67-9f5b-4412-8d95-d1c087925a54 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.189002 Feb 16 05:35:38.411940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 186/408] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:38 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:38.416697 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:38.417947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:38.424109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.424568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.425385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:38.425827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:38.534582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.542192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-861b1292-f42e-48c5-a573-aaa062841e46 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1508 microversion: 2.1 time: 0.165803 Feb 16 05:35:38.542760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 223/409] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:38 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:38.560792 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:38.567986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5500de54-0ea3-4395-adf9-ca8b21add03a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.154782 Feb 16 05:35:38.568490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 187/410] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:38 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:39.237291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:39.237934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:39.244206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.244652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.245524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.245960 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.345810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:39.346420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:39.352534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.352971 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.353773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.354203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.381316 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.391184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0842e772-858d-482a-9c73-a02ff91163f6 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.156887 Feb 16 05:35:39.391879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 224/411] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:39 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:39.430014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:39.431528 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:39.438507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.439054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.439949 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.440463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.494839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.502622 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-03fc86e6-fbbe-4680-b560-497501ee1ecc tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1513 microversion: 2.1 time: 0.160380 Feb 16 05:35:39.503192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 188/412] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:39 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:39.559678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:39.560387 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:39.566486 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.567003 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.567830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.568262 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.586052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.594630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.596185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.597511 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eec73713-b1af-4d41-b12e-9795540c6487 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.171216 Feb 16 05:35:39.598277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 225/413] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:39 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:39.602429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:39.603032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:39.609709 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.610168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.610975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:39.611414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:39.707666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.715549 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-063af35c-0c64-4917-a9c7-ff67a63bfca9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1508 microversion: 2.1 time: 0.159266 Feb 16 05:35:39.724396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 189/414] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:39 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:39.754265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:39.761475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d305adfa-5828-41a8-be48-036b455906b4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.162279 Feb 16 05:35:39.762043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 226/415] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:39 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:40.408335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:40.409000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:40.415257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.415709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.416483 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.416919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.519793 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:40.520385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:40.527229 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.527676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.528459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.528890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.558190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.566189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-47d9a8e5-cd1e-4ee3-bde8-5a6ca8afcd2c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.162299 Feb 16 05:35:40.566764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 190/416] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:40 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:40.616656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:40.617473 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:40.623307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.623759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.624675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.625069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.670897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.678954 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-07a6b9da-caf0-4b07-902f-c041d828b644 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1513 microversion: 2.1 time: 0.162681 Feb 16 05:35:40.679548 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 227/417] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:40 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:40.732128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:40.733117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:40.739545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.740001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.741055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.741531 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.770865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.781035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.782587 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.783962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0b56c17c-206e-4464-84c8-90bd1e5c8d39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.171495 Feb 16 05:35:40.794921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 191/418] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:40 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:40.794921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:40.794921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:40.798629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.799211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.799998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:40.800682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:40.883848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.891787 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-34ac24bd-92ec-416d-9468-fa565787d5aa tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1514 microversion: 2.1 time: 0.163780 Feb 16 05:35:40.892558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 228/419] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:40 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:40.947218 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:40.954841 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-22827f11-b1f2-410e-a2e9-169b170948d3 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.169334 Feb 16 05:35:40.955509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 192/420] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:40 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:41.584559 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:41.585749 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:41.594715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.595180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.595982 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.596422 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.633285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-bfe8b9ed-8b8a-4c08-bf3b-6cf721dd78d8 req-5116de54-8a08-4237-a00b-60a87c9e9ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e669e6a-26fc-48ca-be5b-b4f882ba61de", "name": "network-vif-deleted", "tag": "973b69b7-1831-4e77-9b05-2bae4a584505"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:41.634834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:41.634834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:41.646193 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-bfe8b9ed-8b8a-4c08-bf3b-6cf721dd78d8 req-5116de54-8a08-4237-a00b-60a87c9e9ed0 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.646947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-bfe8b9ed-8b8a-4c08-bf3b-6cf721dd78d8 req-5116de54-8a08-4237-a00b-60a87c9e9ed0 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.665835 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-bfe8b9ed-8b8a-4c08-bf3b-6cf721dd78d8 req-5116de54-8a08-4237-a00b-60a87c9e9ed0 service nova] Creating event network-vif-deleted:973b69b7-1831-4e77-9b05-2bae4a584505 for instance 0e669e6a-26fc-48ca-be5b-b4f882ba61de on hv-cinder-82947 Feb 16 05:35:41.676217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-bfe8b9ed-8b8a-4c08-bf3b-6cf721dd78d8 req-5116de54-8a08-4237-a00b-60a87c9e9ed0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046402 Feb 16 05:35:41.679448 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 193/421] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:41.706561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:41.708021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:41.719002 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.719455 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.720427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.721049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.809825 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:41.827308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cfe23576-8b3c-408c-85b9-e4bca3937820 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.241627 Feb 16 05:35:41.832117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 229/422] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:41 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:41.837755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:41.838675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:41.846223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.848277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.849447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.849561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:41.850238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.861091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d2f0277d-2b54-4354-9af2-95073b46ba0f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 200 len: 1302 microversion: 2.1 time: 0.161948 Feb 16 05:35:41.897170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 194/423] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:41 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:41.974437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:41.975355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:41.981998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.982722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:41.983975 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:41.984687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.024662 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.039141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.043435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.046459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1593e50c-16da-4caa-a36c-d974d3cd027b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.212924 Feb 16 05:35:42.047992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 230/424] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:41 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:42.087666 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-c31da771-af4d-4675-9c76-410855d3dbbc req-1f1d9dcb-4643-44be-b3d2-b99bf9d739a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc32bbc-43a6-4be6-91fb-c186a02af50c", "name": "network-vif-plugged", "status": "completed", "tag": "325b6ba7-382f-4677-8261-a77bd7a69aef"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:42.089843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:42.089843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:35:42.104383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c31da771-af4d-4675-9c76-410855d3dbbc req-1f1d9dcb-4643-44be-b3d2-b99bf9d739a6 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.105186 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-c31da771-af4d-4675-9c76-410855d3dbbc req-1f1d9dcb-4643-44be-b3d2-b99bf9d739a6 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.120335 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-c31da771-af4d-4675-9c76-410855d3dbbc req-1f1d9dcb-4643-44be-b3d2-b99bf9d739a6 service nova] Creating event network-vif-plugged:325b6ba7-382f-4677-8261-a77bd7a69aef for instance adc32bbc-43a6-4be6-91fb-c186a02af50c on hv-cinder-82947 Feb 16 05:35:42.126441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-c31da771-af4d-4675-9c76-410855d3dbbc req-1f1d9dcb-4643-44be-b3d2-b99bf9d739a6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042378 Feb 16 05:35:42.128702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 231/425] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:35:42.180595 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.201768 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-03cfecb6-7c69-49c7-8009-526b927cc614 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.233580 Feb 16 05:35:42.205288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 195/426] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:41 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:42.235871 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:42.236540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:42.244278 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.245349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.246511 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.247226 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.393223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.401118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-73a3fbe2-3f51-48fc-86c6-d68487e8393a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1514 microversion: 2.1 time: 0.170231 Feb 16 05:35:42.402024 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 232/427] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:42 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:42.420063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb89719f-1d99-492f-b83e-7f656f5f1d0d"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:42.421848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:42.428911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.429436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.430257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.430690 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.838047 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:42.838660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:42.845678 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.846136 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.846912 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:42.847350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:42.988878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:42.999882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1de5d248-624d-44d9-a903-e65993c702ad tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.164797 Feb 16 05:35:43.010234 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 233/428] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:42 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:43.012773 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:43.013502 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 0e669e6a-26fc-48ca-be5b-b4f882ba61de] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:43.020113 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.020535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.021353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.021792 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.036235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Instance 0e669e6a-26fc-48ca-be5b-b4f882ba61de could not be found. Feb 16 05:35:43.036827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 404 to user: Instance 0e669e6a-26fc-48ca-be5b-b4f882ba61de could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:35:43.037677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3035befa-8527-4422-96ce-3bd9fd575116 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de" status: 404 len: 111 microversion: 2.1 time: 0.028615 Feb 16 05:35:43.038235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 234/429] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:43 2022] GET /compute/v2.1/servers/0e669e6a-26fc-48ca-be5b-b4f882ba61de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:43.077063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:43.084389 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:43.095424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.096773 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.104190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.104867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.194265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f393a498-c563-47f9-9051-6b12b716f56a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778941 Feb 16 05:35:43.195784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 196/430] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:35:42 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:43.224373 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:43.226269 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:43.235296 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.235793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.236621 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:43.237060 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:43.277146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:43.289180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:43.290846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:43.292029 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a0118118-7bed-4e8d-a750-ceb9e89714f9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.220904 Feb 16 05:35:43.292585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 235/431] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:43 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:43.412451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:43.414591 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3eb533da-fefd-492c-8508-62f83a6d018f tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1319 microversion: 2.1 time: 0.196701 Feb 16 05:35:43.415343 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 197/432] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:43 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:44.018473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:44.019076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:44.025365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.025816 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.026606 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.027040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.177166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.185987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b1100530-c974-4738-88c1-9486836c9274 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.171767 Feb 16 05:35:44.186503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 236/433] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:44 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:44.206806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:44.207313 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:44.213523 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.213904 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.214948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.215138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.241663 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:35:44.313582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:44.314475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:44.322633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.323249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6fddc7fc-61c7-4dc4-bf33-3923851ef8fd tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 204 len: 0 microversion: 2.1 time: 0.119946 Feb 16 05:35:44.323695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.323880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 198/434] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:35:44 2022] DELETE /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:35:44.325053 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.325758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.334953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:44.335938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:44.343046 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.343556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.344482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.344831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.487734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.498601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.502826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.504029 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-30085307-5707-4984-a3af-9f6140dbbe4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.196457 Feb 16 05:35:44.504879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 237/435] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:44 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:44.510616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.520582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:44.521217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-96cc112b-55a3-44b1-9f23-a1a41fd1bd7e tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1515 microversion: 2.1 time: 0.192858 Feb 16 05:35:44.521640 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:44.521905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 199/436] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:44 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:44.529081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.529728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.531091 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:44.531535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:44.663490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:44.671093 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8ad058fd-0ca1-41c0-9903-22aa81ebff33 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1507 microversion: 2.1 time: 0.156298 Feb 16 05:35:44.672227 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 238/437] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:44 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:45.204279 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:45.204912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:45.211039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.211569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.212265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.212745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.348669 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:45.356384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9c1e4986-3d0c-4f99-a4ca-d4b3f85dc74e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.155786 Feb 16 05:35:45.357076 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 200/438] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:45 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:45.523795 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:45.524401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:45.531245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.531695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.532468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.532907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.539471 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:45.540152 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:45.546788 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.547230 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.547991 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:45.548421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:45.716596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:45.727361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:45.729966 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:45.731277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ce2873ba-ba59-4c93-b1a4-5166b47267c5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.211074 Feb 16 05:35:45.731827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 239/439] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:45 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:45.736393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:45.744320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-905142be-84ed-4af7-9cea-7677b1e26699 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1515 microversion: 2.1 time: 0.208487 Feb 16 05:35:45.744885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 201/440] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:45 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:46.373598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:46.374906 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:46.380960 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.381540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.382347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.382787 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.518532 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:46.526282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2cabc25f-bc35-4c00-b1df-ab6bfdddf86f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.156331 Feb 16 05:35:46.526855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 240/441] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:46 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:46.749035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:46.750208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:46.756466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.756891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.757775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.758220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.762107 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:46.762706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:46.769011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.769498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.770281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:46.770722 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:46.917881 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:46.918624 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:46.926869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fa2a1671-8b16-489a-ad07-ae7af6a7b7ed tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1515 microversion: 2.1 time: 0.168781 Feb 16 05:35:46.927804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:46.927940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 241/442] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:46 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:46.929732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:46.930900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b4f2d59a-3574-48bf-9519-7b4a61a79a48 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.185578 Feb 16 05:35:46.931444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 202/443] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:46 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:47.543479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:47.544098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:47.550486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.550935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.551715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.552146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.674516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-94405e47-ca8e-4bd4-bcd0-5c381880c0ab req-2f93661b-0df5-4218-9de9-49c1dbdc9e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a3cf44-4b52-472e-8e55-9209e88f127d", "name": "network-vif-deleted", "tag": "1a2ee93b-aa41-40e5-b336-729f04e7e5c2"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:47.676674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:47.676674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:47.695624 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-94405e47-ca8e-4bd4-bcd0-5c381880c0ab req-2f93661b-0df5-4218-9de9-49c1dbdc9e78 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.696322 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-94405e47-ca8e-4bd4-bcd0-5c381880c0ab req-2f93661b-0df5-4218-9de9-49c1dbdc9e78 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.739538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-94405e47-ca8e-4bd4-bcd0-5c381880c0ab req-2f93661b-0df5-4218-9de9-49c1dbdc9e78 service nova] Creating event network-vif-deleted:1a2ee93b-aa41-40e5-b336-729f04e7e5c2 for instance 64a3cf44-4b52-472e-8e55-9209e88f127d on hv-cinder-82947 Feb 16 05:35:47.755786 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-94405e47-ca8e-4bd4-bcd0-5c381880c0ab req-2f93661b-0df5-4218-9de9-49c1dbdc9e78 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090569 Feb 16 05:35:47.766676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 203/444] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:47.806728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:47.825174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ad4f2e78-bdc6-467e-b066-448c6dfdf1d5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.285104 Feb 16 05:35:47.826048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 242/445] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:47 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:47.949289 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:47.949964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:47.950933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:47.951933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:47.963637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.964098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.964776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.965075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.965452 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.965568 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:47.966548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:47.967156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:48.001330 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:48.001884 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:48.002230 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lazy-loading 'fault' on Instance uuid 64a3cf44-4b52-472e-8e55-9209e88f127d {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:35:48.049320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:48.056676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ab4535fb-fe49-449a-9485-555858213b74 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 200 len: 1308 microversion: 2.1 time: 0.116472 Feb 16 05:35:48.057510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 204/446] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:47 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:48.121012 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:48.131875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:48.134033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:48.135407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cff0a3b4-6c4b-4ca1-8082-8b1c0f542512 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.190226 Feb 16 05:35:48.145961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 243/447] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:47 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:48.843790 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:48.844405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:48.850676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:48.851131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:48.851907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:48.852351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:48.980132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:48.988436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-97916ab7-7ce8-43d6-911d-1b06fc5569e5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.148376 Feb 16 05:35:48.989003 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 205/448] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:48 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:49.074270 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:49.074879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 64a3cf44-4b52-472e-8e55-9209e88f127d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:49.081508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.081960 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.082736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.083171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.098240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Instance 64a3cf44-4b52-472e-8e55-9209e88f127d could not be found. Feb 16 05:35:49.099201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 404 to user: Instance 64a3cf44-4b52-472e-8e55-9209e88f127d could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:35:49.100055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5837141c-b030-4cd1-ad5c-81ab9990882f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d" status: 404 len: 111 microversion: 2.1 time: 0.029478 Feb 16 05:35:49.100631 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 244/449] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:49 2022] GET /compute/v2.1/servers/64a3cf44-4b52-472e-8e55-9209e88f127d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:49.108371 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:49.109531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:49.115506 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.115960 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.116737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.117174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.140327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:35:49.154774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:49.154774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:49.160613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.161062 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.161880 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.162315 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.237459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-bbdc2648-1edc-4ed1-a797-244efe41217f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 204 len: 0 microversion: 2.1 time: 0.132253 Feb 16 05:35:49.238551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 206/450] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:35:49 2022] DELETE /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:35:49.246895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:49.247737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:49.253854 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.254518 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.255421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:49.255952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:49.323884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:49.332690 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:49.334228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:49.335432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0109be70-29d2-4d5c-bd75-aed214038031 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.185644 Feb 16 05:35:49.335942 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 245/451] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:49 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:49.403276 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:49.411695 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-be6fa136-c96f-4565-b02e-b0b702ae5ec6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1515 microversion: 2.1 time: 0.169172 Feb 16 05:35:49.412259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 207/452] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:49 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:49.843588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2020189281", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:50.004861 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:50.005496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:50.011679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.012123 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.012887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.013353 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.150934 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:50.160006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2d1a05e2-2e94-44ce-8355-ee0783461d55 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.158706 Feb 16 05:35:50.160971 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 208/453] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:50 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:50.354518 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:50.355061 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:50.361002 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.361499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.362287 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.362726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.505597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:50.516597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:50.518894 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:50.520314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6675831e-6de5-4497-9d35-99a4ec20a90c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.169924 Feb 16 05:35:50.520948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 209/454] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:50 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:50.525548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:50.526325 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:50.534801 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.535298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.536113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.536556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.684913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:50.694055 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c763ad0b-a757-4fc2-a7b7-770c6f31df36 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1515 microversion: 2.1 time: 0.171920 Feb 16 05:35:50.703643 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 210/455] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:50 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:50.731781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:50.732782 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:50.740293 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.740739 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.741537 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.741973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.764981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lazy-loading 'flavor' on Instance uuid 032cece1-a548-4e1f-a72a-b3647d09718c {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:35:50.883662 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4183a29f-b64b-4b88-89cb-c583107974eb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action" status: 200 len: 32 microversion: 2.1 time: 0.155492 Feb 16 05:35:50.884183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 211/456] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:35:50 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 16 05:35:50.893746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:50.894432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:50.900289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.900742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:50.901545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:50.901980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.070392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.078148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-35bee8da-2b03-4192-adc7-54cdc428a305 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.188618 Feb 16 05:35:51.078736 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 212/457] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:50 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:51.177969 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:51.178499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:51.185053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.185606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.186437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.186873 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.385039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.393083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-687f4917-0b53-4a6c-8baf-9139ea57c807 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1722 microversion: 2.1 time: 0.218843 Feb 16 05:35:51.393787 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 213/458] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:51 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:51.538514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:51.539121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:51.552442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.553164 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.554007 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.554440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.762800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.770588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.772074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.773217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-522b000b-80c0-42e4-87e8-f2482f0b5468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1743 microversion: 2.20 time: 0.238408 Feb 16 05:35:51.773802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 214/459] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:51 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:51.777946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:51.778543 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:51.786715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.787173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.787959 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:51.788392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:51.930994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:51.938631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8cebbde8-2376-48e1-b355-93b77dbb54c6 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 200 len: 1515 microversion: 2.1 time: 0.163805 Feb 16 05:35:51.939359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 215/460] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:51 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:52.095180 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-e1ba3335-25fb-4868-873c-e9fe3d2223e3 req-18b48a7c-d008-4254-9e2b-a8a548433090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a05cc5-5174-4d41-a407-fc4311b4f6e9", "name": "network-vif-deleted", "tag": "5f1e1dcc-fb0d-43bd-a284-85872e5284c7"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:52.097064 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:52.097064 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:52.106048 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-e1ba3335-25fb-4868-873c-e9fe3d2223e3 req-18b48a7c-d008-4254-9e2b-a8a548433090 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.106499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-e1ba3335-25fb-4868-873c-e9fe3d2223e3 req-18b48a7c-d008-4254-9e2b-a8a548433090 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.119543 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-e1ba3335-25fb-4868-873c-e9fe3d2223e3 req-18b48a7c-d008-4254-9e2b-a8a548433090 service nova] Creating event network-vif-deleted:5f1e1dcc-fb0d-43bd-a284-85872e5284c7 for instance 69a05cc5-5174-4d41-a407-fc4311b4f6e9 on hv-cinder-82947 Feb 16 05:35:52.125424 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-e1ba3335-25fb-4868-873c-e9fe3d2223e3 req-18b48a7c-d008-4254-9e2b-a8a548433090 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Feb 16 05:35:52.126094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 216/461] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:35:52.137147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:52.137946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:52.145240 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.145716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.146507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.146945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.288998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:52.297772 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c118a392-4900-4d48-abec-479f8225d41c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.168428 Feb 16 05:35:52.298452 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 217/462] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:52 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:52.410492 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:52.411114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:52.416811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.417281 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.418068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.418503 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.554107 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:52.562140 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-18e779f6-3672-4235-8b91-04f844f6c3bb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1699 microversion: 2.1 time: 0.155329 Feb 16 05:35:52.562712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 218/463] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:52 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:52.579054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7ddb26ad-2c86-4074-b322-9a189e5529cb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:52.585144 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ddb26ad-2c86-4074-b322-9a189e5529cb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.585632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ddb26ad-2c86-4074-b322-9a189e5529cb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.607319 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7ddb26ad-2c86-4074-b322-9a189e5529cb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Going to try to start instance {{(pid=122879) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 16 05:35:52.645620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7ddb26ad-2c86-4074-b322-9a189e5529cb tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action" status: 202 len: 0 microversion: 2.1 time: 0.070539 Feb 16 05:35:52.646234 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 219/464] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:35:52 2022] POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 05:35:52.654394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:52.655080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:52.661764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.662410 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.663325 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.663764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.814013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:52.822024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5a498c07-1e70-4aae-9486-d740e2a84b36 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1708 microversion: 2.1 time: 0.171484 Feb 16 05:35:52.822601 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 220/465] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:52 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1708 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:52.833829 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:52.834434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:52.840712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.841167 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.841992 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:52.842432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:52.989930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:52.997836 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:52.999494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:53.000640 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f4cb4322-b8a5-4e63-9c09-7bfc68128a99 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1743 microversion: 2.20 time: 0.170416 Feb 16 05:35:53.001196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 221/466] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:52 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:35:53.005782 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:53.006320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: 69a05cc5-5174-4d41-a407-fc4311b4f6e9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:53.014001 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.014445 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.015245 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.015676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.028512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Instance 69a05cc5-5174-4d41-a407-fc4311b4f6e9 could not be found. Feb 16 05:35:53.029100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 404 to user: Instance 69a05cc5-5174-4d41-a407-fc4311b4f6e9 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:35:53.029938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e37666da-0d92-40c8-be0b-ddda5a47fe7f tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9" status: 404 len: 111 microversion: 2.1 time: 0.027639 Feb 16 05:35:53.031010 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 222/467] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:53 2022] GET /compute/v2.1/servers/69a05cc5-5174-4d41-a407-fc4311b4f6e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:53.315457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:53.316909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:53.323475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.323934 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.324725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.325166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.473485 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:53.481640 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b08fb0fc-3101-41a9-9cc3-8efdccd33948 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.169880 Feb 16 05:35:53.482335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 223/468] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:53 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:53.838915 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:53.839545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:53.846882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.847248 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.848045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:53.848488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:53.997594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.005912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1ecbf6b8-8809-459b-92e5-588f5a9a7f11 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1708 microversion: 2.1 time: 0.170748 Feb 16 05:35:54.006486 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 224/469] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:53 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:54.020354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:54.020967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:54.026731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.027182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.027961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.028399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.165124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.174173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.175662 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.176800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-19f41fa9-6a97-4c4b-b5dd-eb91fcf9321c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1743 microversion: 2.20 time: 0.162136 Feb 16 05:35:54.177378 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 225/470] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:54 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:54.181460 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:54.181943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:54.187451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.187966 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.188824 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.189357 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.213470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:35:54.293431 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-135a869e-5d81-428d-bb9b-53a2d24fe539 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 204 len: 0 microversion: 2.1 time: 0.114784 Feb 16 05:35:54.294023 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 226/471] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:35:54 2022] DELETE /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:35:54.302249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:54.302936 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:54.308511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.308959 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.309763 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.310200 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.447397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.455645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d022c280-d79a-4fad-8705-d3f1bea155ce tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1514 microversion: 2.1 time: 0.156884 Feb 16 05:35:54.461310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 227/472] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:54 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:54.503413 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:54.503752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:54.517403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.517403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.517403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:54.517403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:54.651241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:54.659779 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-68059643-f9ef-4158-8496-6091887f1487 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.160328 Feb 16 05:35:54.660336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 228/473] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:54 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:55.023408 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:55.023930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:55.029827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.030283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.031069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.031508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.163013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.171011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e77ef1a7-4db5-48ca-93f7-72ba20dea552 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1712 microversion: 2.1 time: 0.151339 Feb 16 05:35:55.171586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 229/474] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:55 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:55.194820 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:55.195429 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:55.201871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.202531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.204166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.204620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.339679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.348834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.350401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.351627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-545e9d08-b156-4cc7-a9bb-cb0f7565d513 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.160438 Feb 16 05:35:55.352183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 230/475] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:55 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:55.472257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:55.472867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:55.479012 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.479455 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.480253 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.480784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.619777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.627716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-34fcc10b-f057-4890-8e2b-ef760a67b240 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1514 microversion: 2.1 time: 0.159762 Feb 16 05:35:55.628273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 231/476] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:55 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:55.676746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:55.677383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:55.683757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.684206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.685006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.685489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.822354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:55.830304 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b4b992b9-b239-43e6-abff-f2a010782515 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.157677 Feb 16 05:35:55.840205 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 232/477] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:55 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:55.848687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-6f6a3955-57ea-4a34-9fff-3f83711db1e0 req-2e611a89-f1c2-455a-b41e-06a670b2dbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "name": "network-vif-plugged", "status": "completed", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:55.848687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:55.848687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:55.855106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-6f6a3955-57ea-4a34-9fff-3f83711db1e0 req-2e611a89-f1c2-455a-b41e-06a670b2dbc9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:55.855553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-6f6a3955-57ea-4a34-9fff-3f83711db1e0 req-2e611a89-f1c2-455a-b41e-06a670b2dbc9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:55.867217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-6f6a3955-57ea-4a34-9fff-3f83711db1e0 req-2e611a89-f1c2-455a-b41e-06a670b2dbc9 service nova] Creating event network-vif-plugged:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:35:55.872203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-6f6a3955-57ea-4a34-9fff-3f83711db1e0 req-2e611a89-f1c2-455a-b41e-06a670b2dbc9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030732 Feb 16 05:35:55.872790 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 233/478] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:56.370199 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:56.370790 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:56.377954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.378399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.379174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.379609 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.516775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:56.525683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:56.527184 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:56.528339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3d255274-74d6-48f0-9698-1f2abbc167ba tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.162567 Feb 16 05:35:56.528897 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 234/479] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:56 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:56.644348 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:56.644882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:56.650744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.651192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.651962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.652396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.788250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:56.795737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f68e1ce8-fa75-477c-b24d-18c3ce19603a tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1514 microversion: 2.1 time: 0.155785 Feb 16 05:35:56.796302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 235/480] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:56 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:56.847842 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:56.848551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:56.854494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.854944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.855848 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:56.856263 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:56.990202 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:56.997931 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ed4b0bc7-7d01-4a90-a41c-67988a38cfff tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.154315 Feb 16 05:35:56.998502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 236/481] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:56 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:57.139512 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] validate_networks() for None {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:35:57.493575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:35:57.494008 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:35:57.494486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:35:57.495011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:35:57.495755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:35:57.505767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.506365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.507460 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.507989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.532215 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Getting quotas for project c3842ab0db9e47b49407435096f0a223. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:35:57.536349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Getting quotas for user 299705dbdd0e4cda82359be6a32faaa6 and project c3842ab0db9e47b49407435096f0a223. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:35:57.548298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:35:57.549104 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:57.549793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:57.551718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:35:57.558963 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.559421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.560214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.561055 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.606638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5a1f9674-ee52-42ac-88a2-6ff0d0efac8e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.767143 Feb 16 05:35:57.607607 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 246/482] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 7769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:35:57.621242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8ffef66b-a539-4282-b6b1-f86b2cfd8710 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:57.622495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8ffef66b-a539-4282-b6b1-f86b2cfd8710 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:57.744097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8ffef66b-a539-4282-b6b1-f86b2cfd8710 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:57.752702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8ffef66b-a539-4282-b6b1-f86b2cfd8710 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1215 microversion: 2.1 time: 0.135045 Feb 16 05:35:57.761431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 247/483] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:57 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:57.787754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:57.798311 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:57.800474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:57.802647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-57bd05a5-9e35-4247-b4a7-9ebc8574093c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.258813 Feb 16 05:35:57.803574 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 237/484] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:57 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:57.816483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:57.818061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:57.831474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.832219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.833423 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.833966 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.893898 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-3c1710ea-4a32-4b44-bc5a-02b6c926ce84 req-340dacb2-bad2-49b4-817a-553f7a0bef5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17fb4ec-2dea-41d2-acff-bf1c3e982833", "name": "network-vif-deleted", "tag": "f95645a6-2fbd-42df-b9db-d604a04d8bfa"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:35:57.898147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:35:57.898147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:35:57.905744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-3c1710ea-4a32-4b44-bc5a-02b6c926ce84 req-340dacb2-bad2-49b4-817a-553f7a0bef5b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:57.906472 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-3c1710ea-4a32-4b44-bc5a-02b6c926ce84 req-340dacb2-bad2-49b4-817a-553f7a0bef5b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:57.920514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-3c1710ea-4a32-4b44-bc5a-02b6c926ce84 req-340dacb2-bad2-49b4-817a-553f7a0bef5b service nova] Creating event network-vif-deleted:f95645a6-2fbd-42df-b9db-d604a04d8bfa for instance c17fb4ec-2dea-41d2-acff-bf1c3e982833 on hv-cinder-82947 Feb 16 05:35:57.928830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-3c1710ea-4a32-4b44-bc5a-02b6c926ce84 req-340dacb2-bad2-49b4-817a-553f7a0bef5b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041243 Feb 16 05:35:57.930331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 238/485] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:35:57.931656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65045a2a88084c12aeb9133bf0162193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1050764769f2439fae8ad76e27663aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:57.942449 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ab8e22c5-96b8-4529-8682-acc3c85422c0 tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 200 len: 1472 microversion: 2.1 time: 0.129581 Feb 16 05:35:57.946158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 248/486] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:57 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 1472 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:35:58.017587 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:58.018507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:58.032629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.033393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.034220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.037881 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.237331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:58.245808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-66c16f79-f789-4eed-b220-e58adc37dee5 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.234380 Feb 16 05:35:58.246490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 239/487] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:58 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:58.775044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:58.776842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:58.784594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.785061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.787693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.788158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.823606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:58.824811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:58.834214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.834671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.835443 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.835869 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.898177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:58.906621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4c7736a0-fcf8-4527-8162-0786a8e497c4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1267 microversion: 2.1 time: 0.135468 Feb 16 05:35:58.907457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 249/488] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:58 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:58.964627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:58.965567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] [instance: c17fb4ec-2dea-41d2-acff-bf1c3e982833] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:58.979777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.980398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:58.981357 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:58.981964 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:59.001110 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] HTTP exception thrown: Instance c17fb4ec-2dea-41d2-acff-bf1c3e982833 could not be found. Feb 16 05:35:59.002116 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] Returning 404 to user: Instance c17fb4ec-2dea-41d2-acff-bf1c3e982833 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:35:59.003166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5c2ac4dd-6449-42a6-911f-60d6390b655c tempest-AttachVolumeNegativeTest-9566673 tempest-AttachVolumeNegativeTest-9566673-project] 10.222.0.75 "GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833" status: 404 len: 111 microversion: 2.1 time: 0.043602 Feb 16 05:35:59.007407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 250/489] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:58 2022] GET /compute/v2.1/servers/c17fb4ec-2dea-41d2-acff-bf1c3e982833 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:59.034930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:59.046890 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:59.049418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:59.050917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7571fd8e-5e87-47dc-9fe5-e5d69f396b00 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.230899 Feb 16 05:35:59.061498 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 240/490] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:35:58 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:35:59.263013 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:59.263624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:59.277221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:59.277713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:59.278534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:59.278978 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:59.911156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:35:59.924131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:35:59.925415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:35:59.935033 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:59.935385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-31225962-1ad5-4f95-8808-dba75dbe069c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.673311 Feb 16 05:35:59.936523 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:35:59.937445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 251/491] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:59 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:35:59.938490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:35:59.939095 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:00.029768 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:00.045437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5b50cf89-ae4a-4487-8e12-b500bd4496cd tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1273 microversion: 2.1 time: 0.124838 Feb 16 05:36:00.061396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 241/492] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:35:59 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:00.073148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:00.074114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:00.082312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:00.083169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:00.084193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:00.084811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:00.442829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:00.452449 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:00.456198 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:00.458766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4914ebc1-0025-4e7e-94ee-17fcdecb32de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.391678 Feb 16 05:36:00.474567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 252/493] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:00 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:00.957200 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:00.958123 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:00.970905 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:00.971386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:00.976072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:00.977632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:01.111566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:01.113123 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:01.120575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:01.121492 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:01.122754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:01.123421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:01.218701 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:01.250415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a39627cb-4869-4fbe-acac-f6411604def3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.300775 Feb 16 05:36:01.251568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 242/494] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:00 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:01.431133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:01.450148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c4f4815b-18cc-4ffc-90a1-b04f2310c8af tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.381763 Feb 16 05:36:01.459700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 253/495] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:01 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:01.479597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:01.480699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:01.488116 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:01.489551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:01.491225 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:01.491888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:01.735817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:01.746648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:01.749629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:01.751954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1599ce7f-7472-4629-82b7-84c1eae11e4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.277231 Feb 16 05:36:01.753205 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 243/496] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:01 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:02.054976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-dd9e66e9-c88c-49e5-862a-610629bd2d46 req-1670e937-cfa7-476b-9f47-95bff8668870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd001e88-213f-4c79-995c-3e01e8481ace", "tag": "790c8cdb-b4f4-466f-aeb2-308d8707993f"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:02.057017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:36:02.057017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:36:02.071477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-dd9e66e9-c88c-49e5-862a-610629bd2d46 req-1670e937-cfa7-476b-9f47-95bff8668870 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.072125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-dd9e66e9-c88c-49e5-862a-610629bd2d46 req-1670e937-cfa7-476b-9f47-95bff8668870 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.094942 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-dd9e66e9-c88c-49e5-862a-610629bd2d46 req-1670e937-cfa7-476b-9f47-95bff8668870 service nova] Creating event network-changed:790c8cdb-b4f4-466f-aeb2-308d8707993f for instance dd001e88-213f-4c79-995c-3e01e8481ace on hv-cinder-82947 Feb 16 05:36:02.102093 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-dd9e66e9-c88c-49e5-862a-610629bd2d46 req-1670e937-cfa7-476b-9f47-95bff8668870 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050642 Feb 16 05:36:02.103406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 254/497] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:36:02.271022 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:02.272330 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:02.288531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.289884 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.291673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.292291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.477055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:02.477791 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:02.487577 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.488035 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.488837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.489289 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.519564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:02.529968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ea818ea1-3178-4022-8a4f-65fc6d8900a2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.264126 Feb 16 05:36:02.545685 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 244/498] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:02 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:02.784635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:02.785424 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:02.800268 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.801386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.804766 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:02.805403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:02.861387 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:02.873142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9dbe52a1-4158-48a2-bf54-34bbf693af07 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.400740 Feb 16 05:36:02.874816 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 255/499] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:02 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:03.050637 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:03.063941 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:03.069489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:03.072689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3dfe9307-467b-4127-a0f3-e588fd34e99e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.296207 Feb 16 05:36:03.074375 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 245/500] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:02 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:03.549354 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:03.549965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:03.558864 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:03.562076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:03.566801 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:03.567558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:03.875623 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:03.883828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b8af5527-a2e4-4263-9484-e00bc6fc7c29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.339125 Feb 16 05:36:03.888483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 256/501] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:03 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:03.897521 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:03.898869 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:03.910535 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:03.911762 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:03.912796 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:03.913559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:04.080018 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:04.092470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6fcaf5ae-91d4-42ec-adee-8db1f9a26cc4 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.204909 Feb 16 05:36:04.105980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 246/502] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:03 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:04.110875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:04.111490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:04.119533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:04.120196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:04.121175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:04.121951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:04.284869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:04.296431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:04.298498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:04.299873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0aa81998-933f-4322-98b1-6e02d7a4804c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.193071 Feb 16 05:36:04.300785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 257/503] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:04 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:04.905747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:04.906987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:04.914732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:04.915439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:04.916678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:04.917163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:05.091529 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:05.101639 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-bfc1d989-eec1-48d2-81e9-5e85aa2fb019 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.199630 Feb 16 05:36:05.102733 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 247/504] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:04 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:05.117961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:05.119125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:05.127193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:05.127951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:05.128988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:05.129767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:05.309916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:05.319180 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:05.320087 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:05.330419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:05.330863 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:05.331634 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-244dae7f-86f3-4bed-b0a3-6c4e340b70f3 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.218305 Feb 16 05:36:05.332124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:05.332933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 258/505] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:05 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:05.333118 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:05.518449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:05.526723 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:05.528221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:05.529388 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4f63de7b-b99d-49cc-afdc-dd970b3c4cc3 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.214474 Feb 16 05:36:05.540411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 248/506] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:05 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:06.121576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:06.122822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:06.129949 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.130701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.131767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.132443 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.289226 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:06.306647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3c744d0b-4513-4435-a3ed-5ad6df7c18e0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.179892 Feb 16 05:36:06.307541 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 259/507] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:06 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:06.348562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:06.350137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:06.357331 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.358361 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.359986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.361125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.550438 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:06.551063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:06.571120 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.571625 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.572479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:06.572923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:06.586929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:06.596367 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-146ad4c6-0c9d-4c1c-9393-448327d74abb tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.251329 Feb 16 05:36:06.596969 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 249/508] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:06 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:06.802140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:06.813974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:06.815837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:06.817026 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fbe3f438-40c3-4c7b-9ca0-d63e2b02aaa1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.271778 Feb 16 05:36:06.818149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 260/509] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:06 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:07.323429 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:07.324071 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:07.330546 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.331114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.332035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.332899 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.471771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:07.479483 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cb54ab0a-8cbb-45ec-95ec-b3630c47fb55 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.159652 Feb 16 05:36:07.480052 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 250/510] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:07 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:07.613414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:07.614023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:07.620484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.620949 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.621798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.622268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.759969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:07.767242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-af00f5f4-8ffc-4523-ac66-e680f140af02 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.158034 Feb 16 05:36:07.767813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 261/511] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:07 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:07.834889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:07.835524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:07.841464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.841857 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.842649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:07.843089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:07.976629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:07.985182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:07.986698 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:07.987831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-78cd4634-513e-453e-9c32-5693d042f833 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.156452 Feb 16 05:36:07.988394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 251/512] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:07 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:08.505762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:08.505762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:08.525114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:08.533138 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:08.534647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:08.535110 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:08.692522 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:08.700782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c6a635aa-6781-4675-9c6c-5d4e1b17bf71 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.208554 Feb 16 05:36:08.701398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 262/513] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:08 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:08.784462 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:08.785821 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:08.792059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:08.792752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:08.793673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:08.794962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:08.945196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:08.952859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-dc4a3012-a47a-49e5-95d7-ac653e5ccb21 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.172745 Feb 16 05:36:08.954492 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 252/514] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:08 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:09.006321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:09.006932 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:09.013162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.013898 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:09.014691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.015130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:09.154879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:09.169944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:09.171554 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:09.173399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2e4443e5-db9b-4d52-b5d6-81bf0827b84b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.170750 Feb 16 05:36:09.173988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 263/515] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:09 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:09.719384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:09.719967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:09.725923 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.726371 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:09.727150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.727585 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:09.855970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:09.863548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c70618d9-d15c-4eca-81c0-c5816d4d7954 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.148782 Feb 16 05:36:09.864112 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 253/516] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:09 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:09.970512 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:09.971019 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:09.977248 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.977734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:09.978514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:09.978951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:10.113977 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:10.121159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-35dd5a84-dc66-4a6d-91aa-343f28702c4b tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.154382 Feb 16 05:36:10.121767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 264/517] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:09 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:10.191129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:10.192090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:10.199679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:10.200122 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:10.200928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:10.201393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:10.330752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:10.338555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:10.340047 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:10.341215 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2d1beda7-a3be-45b9-90e9-17e9eb4f105e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.154737 Feb 16 05:36:10.341826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 254/518] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:10 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:10.880278 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:10.880811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:10.886698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:10.887146 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:10.887918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:10.888353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.031676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:11.039465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-11da0ff1-85b4-4d96-887e-c449e6113b00 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.162950 Feb 16 05:36:11.040045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 265/519] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:10 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:11.138196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:11.138707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:11.145573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:11.146111 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.146949 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:11.147574 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.284279 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:11.291855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ee29d46b-bdbf-45dd-98ff-329622a5ed2a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.157309 Feb 16 05:36:11.292645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 255/520] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:11 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:11.360121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:11.360733 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:11.366794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:11.367244 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.368023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:11.368465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.532649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:11.540272 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:11.541820 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:11.543002 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c1b69c31-980e-4a53-9dfc-224c003ab0de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1738 microversion: 2.20 time: 0.187121 Feb 16 05:36:11.543572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 266/521] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:11 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:11.912242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-9d00503f-48ae-4eec-8826-854ebce41690 req-8277a83b-0ff6-4f2f-b9ef-7435cc2627c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd001e88-213f-4c79-995c-3e01e8481ace", "name": "network-vif-plugged", "status": "completed", "tag": "790c8cdb-b4f4-466f-aeb2-308d8707993f"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:11.914211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:36:11.914211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:36:11.922906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-9d00503f-48ae-4eec-8826-854ebce41690 req-8277a83b-0ff6-4f2f-b9ef-7435cc2627c5 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:11.923426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-9d00503f-48ae-4eec-8826-854ebce41690 req-8277a83b-0ff6-4f2f-b9ef-7435cc2627c5 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:11.934747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-9d00503f-48ae-4eec-8826-854ebce41690 req-8277a83b-0ff6-4f2f-b9ef-7435cc2627c5 service nova] Creating event network-vif-plugged:790c8cdb-b4f4-466f-aeb2-308d8707993f for instance dd001e88-213f-4c79-995c-3e01e8481ace on hv-cinder-82947 Feb 16 05:36:11.941463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-9d00503f-48ae-4eec-8826-854ebce41690 req-8277a83b-0ff6-4f2f-b9ef-7435cc2627c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Feb 16 05:36:11.942220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 256/522] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:36:12.056105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:12.056716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:12.063688 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.064136 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.064914 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.065379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.307846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:12.312156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:12.313146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:12.316650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-17607b48-6857-460e-8a91-a1c953a9874c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.264066 Feb 16 05:36:12.322130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.323006 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.324159 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.324948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.326303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 267/523] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:12 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:12.482005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:12.490178 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-34ca3ec1-0faa-4617-b874-cc09bbd71d5e tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.183530 Feb 16 05:36:12.490745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 257/524] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:12 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:12.563928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:12.564660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:12.571353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.572264 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.573807 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:12.574697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:12.731240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:12.740688 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:12.742247 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:12.743410 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-735cddd7-5ce8-4d70-9bd7-42b38381871a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.184288 Feb 16 05:36:12.743969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 268/525] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:12 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:13.333493 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:13.334042 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:13.340246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.340699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.341538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.341972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.472099 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:13.479785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-49619146-1954-46b4-8457-a448ac15d3fb tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.150122 Feb 16 05:36:13.480355 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 258/526] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:13 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:13.506935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:13.507545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:13.513881 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.514336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.515114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.515614 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.651627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:13.659394 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9d25132d-0cfc-4bad-bab1-2f4d4f22e705 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1315 microversion: 2.1 time: 0.156101 Feb 16 05:36:13.659972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 269/527] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:13 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:13.761488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:13.762218 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:13.769286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.769826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.770682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:13.771181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:13.929156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:13.939645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:13.941278 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:13.942444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-948e1239-41ae-43a0-aa5e-4cedcbcc9d6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.184706 Feb 16 05:36:13.943053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 259/528] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:13 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:14.497093 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:14.497649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:14.503646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.504118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.504920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.505389 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.636424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:14.644772 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f7d02b23-e992-4d48-b851-4f5e26f599b9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.151450 Feb 16 05:36:14.645371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 270/529] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:14 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:14.675823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:14.676448 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:14.682707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.683156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.683932 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.684369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.805983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdfeb4f8-dcab-41cf-84b1-490e75d715a0", "device": "/dev/sdb"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:14.807750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:14.814142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.814584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.815352 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.815783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.824112 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:14.833149 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4a706baf-f90c-4fe5-9770-6fee85a37e80 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1465 microversion: 2.1 time: 0.160869 Feb 16 05:36:14.833883 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 260/530] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:14 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:14.871744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:14.872317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:14.878801 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.879256 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.880038 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.880476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.905633 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:36:14.983904 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3ec1f6d5-55a3-40d2-bfbe-36892bcba8e8 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "DELETE /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 204 len: 0 microversion: 2.1 time: 0.115860 Feb 16 05:36:14.985235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 261/531] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:36:14 2022] DELETE /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 05:36:14.989979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:14.990789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:14.997564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.998015 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:14.998804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:14.999238 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.083046 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c2eb27f4-c2f2-4bd8-954f-632106679ad4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "POST /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280647 Feb 16 05:36:15.088051 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 271/532] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:36:14 2022] POST /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:36:15.089763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:15.089763 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:15.096799 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:15.097277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.098300 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:15.098919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.164297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:15.173828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:15.179029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:15.180889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cdb2e983-6dca-4505-a346-34d571f171cb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.194719 Feb 16 05:36:15.192769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 262/533] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:14 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:15.261415 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:15.270034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-18da851d-7921-40a9-bd7e-d5f10c5a904f tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1471 microversion: 2.1 time: 0.185015 Feb 16 05:36:15.270650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 272/534] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:15 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:15.662743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:15.663345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:15.670434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:15.670880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.672177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:15.672612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.819113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:15.826804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9032e7bf-bfbe-4302-a6b2-2a5ada0dbe6e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.168254 Feb 16 05:36:15.827370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 263/535] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:15 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:15.880342 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-4a97bb33-4b45-460d-b6fb-27651a1dad9d req-a8ed4ab9-45e0-474e-b96b-dc255a1093e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "name": "network-vif-unplugged", "status": "completed", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:15.881961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:36:15.881961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:36:15.889589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4a97bb33-4b45-460d-b6fb-27651a1dad9d req-a8ed4ab9-45e0-474e-b96b-dc255a1093e3 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:15.890040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4a97bb33-4b45-460d-b6fb-27651a1dad9d req-a8ed4ab9-45e0-474e-b96b-dc255a1093e3 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:15.901814 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-4a97bb33-4b45-460d-b6fb-27651a1dad9d req-a8ed4ab9-45e0-474e-b96b-dc255a1093e3 service nova] Creating event network-vif-unplugged:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:36:15.907001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-4a97bb33-4b45-460d-b6fb-27651a1dad9d req-a8ed4ab9-45e0-474e-b96b-dc255a1093e3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030321 Feb 16 05:36:15.907601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 273/536] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:36:16.199181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:16.199796 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:16.205825 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.206415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.207161 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.207603 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.288212 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:16.288905 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:16.295211 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.295669 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.296972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.297451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.338119 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:16.345893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:16.347401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:16.348558 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-279707a8-c122-4943-84a8-25667faa188b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.153054 Feb 16 05:36:16.349131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 264/537] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:16 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:16.434268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:16.442499 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e6b54c72-542d-4d85-8c5f-5ca0177a475d tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1471 microversion: 2.1 time: 0.158258 Feb 16 05:36:16.443142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 274/538] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:16 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:16.844113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:16.844721 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:16.851250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.851700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.852534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:16.852968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:16.986826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:16.994771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-91a536c2-19e9-4377-a9bd-62bb22cae91b tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.154826 Feb 16 05:36:16.996961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 265/539] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:16 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:17.366180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:17.366821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:17.372649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:17.373097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:17.373913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:17.374338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:17.461949 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:17.462560 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:17.468957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:17.469446 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:17.470231 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:17.470674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:17.507916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:17.515705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:17.517217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:17.518393 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b9128740-9aac-4608-a801-5888b69f2d97 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.155914 Feb 16 05:36:17.518963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 275/540] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:17 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:17.601855 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:17.609777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e4e51edc-e93f-4925-850b-bb131836c0fa tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1471 microversion: 2.1 time: 0.150790 Feb 16 05:36:17.610345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 266/541] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:17 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:18.011468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:18.012069 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:18.018484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.018935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.019700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.020128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.150987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:18.158567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2d8ccc13-ba6e-447f-a5b1-4b7255197d29 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.150792 Feb 16 05:36:18.159128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 276/542] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:18 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:18.536394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:18.537005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:18.543251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.543946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.544730 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.545158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.627095 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:18.627983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:18.633885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.634417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.635336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:18.635983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:18.681869 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:18.691132 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:18.692654 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:18.693867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-99e5d16a-0c44-4e8f-9184-9d5c16b2bbeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1720 microversion: 2.20 time: 0.161305 Feb 16 05:36:18.694621 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 267/543] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:18 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:18.781742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:18.791449 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b6e417ca-7990-4474-bc54-fe97d85c35f2 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1471 microversion: 2.1 time: 0.168596 Feb 16 05:36:18.792594 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 277/544] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:18 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:19.175857 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:19.176462 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:19.182229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.182680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.183477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.183908 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.320490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:19.330752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2bb0f3af-6c31-4d80-a981-e238bbdd4d36 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.158944 Feb 16 05:36:19.338509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 268/545] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:19 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:19.713646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:19.714236 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:19.721064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.721542 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.722319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.722752 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.809850 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:19.810793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:19.820952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.821183 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.828699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.829221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.896831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:19.905340 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:19.909046 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:19.910328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-430cfbe9-c86d-4c4f-acd0-3f359d9a6a14 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1663 microversion: 2.20 time: 0.200479 Feb 16 05:36:19.911163 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 278/546] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:19 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:19.927896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0330ca-3224-4e69-8b11-9925a1c0a06b"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:19.929015 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:19.935488 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.936152 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.937719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:19.938163 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:19.999103 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:20.013338 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-65f35cff-561d-45cd-a79d-d7ff403b8f7a tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1471 microversion: 2.1 time: 0.207225 Feb 16 05:36:20.013894 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 269/547] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:19 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:20.235481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a026e9ee-4d22-46b3-9ff8-33923beeb08c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311291 Feb 16 05:36:20.236112 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 279/548] 10.222.0.75 () {62 vars in 1363 bytes} [Wed Feb 16 05:36:19 2022] POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:36:20.347950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:20.348557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:20.348943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:20.349702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:20.355252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.355633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.356408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.356518 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.356848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.356990 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.357773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.358214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.456435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-08a38fee-42fb-41d6-858f-46cfdb2445b8 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/action" status: 202 len: 0 microversion: 2.20 time: 0.112688 Feb 16 05:36:20.457053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 270/549] 10.222.0.75 () {62 vars in 1318 bytes} [Wed Feb 16 05:36:20 2022] POST /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:36:20.464852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:20.465494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:20.471413 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.471858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.472685 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.473122 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.573973 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:20.608125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9c6dd264-a367-4d86-b2b7-489c48cd9605 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.264222 Feb 16 05:36:20.615537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 280/550] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:20 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:20.650405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:20.671096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:20.680632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:20.683682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-50ac265a-56e5-4bee-95e9-b1412520b4df tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1749 microversion: 2.20 time: 0.221032 Feb 16 05:36:20.685631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 271/551] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:20 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1749 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:20.941716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-96a6a35b-63ea-444d-b4cb-9e584f0b9b36 req-b5b14ad6-0099-461a-9ad9-3b15a90cf566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd001e88-213f-4c79-995c-3e01e8481ace", "name": "network-vif-deleted", "tag": "790c8cdb-b4f4-466f-aeb2-308d8707993f"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:20.943214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:36:20.943214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:36:20.951353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-96a6a35b-63ea-444d-b4cb-9e584f0b9b36 req-b5b14ad6-0099-461a-9ad9-3b15a90cf566 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:20.951797 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-96a6a35b-63ea-444d-b4cb-9e584f0b9b36 req-b5b14ad6-0099-461a-9ad9-3b15a90cf566 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:20.963576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-96a6a35b-63ea-444d-b4cb-9e584f0b9b36 req-b5b14ad6-0099-461a-9ad9-3b15a90cf566 service nova] Creating event network-vif-deleted:790c8cdb-b4f4-466f-aeb2-308d8707993f for instance dd001e88-213f-4c79-995c-3e01e8481ace on hv-cinder-82947 Feb 16 05:36:20.968574 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-96a6a35b-63ea-444d-b4cb-9e584f0b9b36 req-b5b14ad6-0099-461a-9ad9-3b15a90cf566 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031409 Feb 16 05:36:20.969595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 281/552] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:36:21.031623 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:21.032236 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:21.040666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.041470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.042334 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.042994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.106874 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299705dbdd0e4cda82359be6a32faaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3842ab0db9e47b49407435096f0a223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:21.115242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8d785e5b-c75c-4a76-adb0-22c1ad652299 tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 200 len: 1300 microversion: 2.1 time: 0.088811 Feb 16 05:36:21.116241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 272/553] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:21 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:21.632267 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:21.632849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:21.639622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.640646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.641643 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.642277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.706548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:21.706548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:21.714596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.715060 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.716126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:21.716770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:21.792298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:21.800325 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1bd6579d-32b5-4d00-ad80-56f106e9744f tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.172145 Feb 16 05:36:21.801171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 282/554] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:21 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:21.869831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:21.879190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:21.880786 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:21.882022 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4dffab24-72ea-4448-bd86-271613a42258 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1749 microversion: 2.20 time: 0.182000 Feb 16 05:36:21.882642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 273/555] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:21 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:22.133504 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:22.134031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] [instance: dd001e88-213f-4c79-995c-3e01e8481ace] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:22.140191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.140642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:22.141451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.141892 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:22.154649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] HTTP exception thrown: Instance dd001e88-213f-4c79-995c-3e01e8481ace could not be found. Feb 16 05:36:22.155230 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] Returning 404 to user: Instance dd001e88-213f-4c79-995c-3e01e8481ace could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:36:22.156549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0bca22e7-3965-4778-a554-2abb8801f25c tempest-VolumesNegativeTest-1025653841 tempest-VolumesNegativeTest-1025653841-project] 10.222.0.75 "GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace" status: 404 len: 111 microversion: 2.1 time: 0.026901 Feb 16 05:36:22.157070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 283/556] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:22 2022] GET /compute/v2.1/servers/dd001e88-213f-4c79-995c-3e01e8481ace => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:22.818326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:22.819014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:22.834296 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.835743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:22.836748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.837435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:22.900063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:22.901175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:22.911025 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.913056 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:22.914562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:22.915507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:23.019177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:23.027937 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a680e094-4be6-4864-abc1-6178a3664f76 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.214025 Feb 16 05:36:23.029177 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 274/557] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:22 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:23.137958 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:23.147341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:23.148939 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:23.150290 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9d745c1e-46d2-48a9-b696-6b4e16d30d67 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.254360 Feb 16 05:36:23.150926 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 284/558] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:22 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:24.047051 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:24.048303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:24.056679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:24.057049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:24.057945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:24.058454 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:24.171091 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:24.172279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:24.185178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:24.187527 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:24.190190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:24.190641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:24.235179 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:24.244257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-157b17d2-a80d-4c81-847d-e4f09920d7ad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.202458 Feb 16 05:36:24.244936 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 275/559] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:24 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:24.345286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:24.353670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:24.355170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:24.356332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f8de6a29-e66d-47ad-ae58-e751a8ef1355 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.192000 Feb 16 05:36:24.356883 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 285/560] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:24 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:25.262202 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:25.263593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:25.271350 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:25.271787 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:25.272742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:25.273358 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:25.374192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:25.375573 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:25.382046 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:25.382492 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:25.383269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:25.383697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:25.424057 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:25.432830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-468b36fa-cb46-4ad8-8b6d-e405cda262f1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.174425 Feb 16 05:36:25.433730 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 276/561] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:25 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:25.519057 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:25.527397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:25.528875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:25.530030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e42a5e33-a301-454c-ab6b-490b9ab14889 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.159424 Feb 16 05:36:25.540867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 286/562] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:25 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:26.451141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:26.451762 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:26.460902 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:26.461463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:26.463201 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:26.464111 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:26.549545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:26.550896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:26.559125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:26.559674 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:26.560595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:26.561134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:26.619894 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:26.629298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f1fa0f10-bc95-491d-bf0e-dd944f5dbbad tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.181972 Feb 16 05:36:26.645301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 277/563] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:26 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:26.735712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:26.745344 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:26.746945 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:26.748519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7f38419c-29e7-4d8e-b151-1a753d305817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.203318 Feb 16 05:36:26.749955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 287/564] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:26 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:27.656088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:27.656612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:27.663364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:27.663807 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:27.664572 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:27.665000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:27.769627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:27.770294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:27.777414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:27.777868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:27.778654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:27.779096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:27.805074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:27.813816 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f6187a96-edee-4a8a-bdd7-186fb40f1307 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.161444 Feb 16 05:36:27.814390 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 278/565] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:27 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:27.914221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:27.923141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:27.924625 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:27.925794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9aa2833c-06d5-47b3-9133-916e203a9c9e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.159832 Feb 16 05:36:27.926351 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 288/566] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:27 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:28.830742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:28.831273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:28.837828 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:28.838285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:28.839073 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:28.839510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:28.943503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:28.944263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:28.950452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:28.950893 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:28.951664 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:28.952113 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:28.979062 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:28.987379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ac08a755-2641-4e69-ac96-992822fddc39 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.160512 Feb 16 05:36:28.987955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 279/567] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:28 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:29.081402 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:29.089398 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:29.090896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:29.092037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d3753f3c-2cd3-462e-9be5-706cdae0e817 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.152282 Feb 16 05:36:29.092598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 289/568] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:28 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:30.003652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:30.004265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:30.010436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:30.010888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:30.011659 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:30.012093 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:30.109323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:30.109944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:30.116044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:30.116497 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:30.117310 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:30.117754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:30.150716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:30.158952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0811aa0b-0392-4bc7-a100-d81c9460a4bd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.158907 Feb 16 05:36:30.159555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 280/569] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:29 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:30.246569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:30.255225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:30.256744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:30.257923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-66bc9fae-b04a-4a7a-8519-5d781ed91082 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.152067 Feb 16 05:36:30.258493 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 290/570] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:30 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:30.773778 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:36:30.774013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:36:31.175722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:31.176345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:31.182582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:31.183020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:31.183781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:31.184206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:31.275607 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:31.276224 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:31.283126 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:31.283579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:31.284363 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:31.284804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:31.314770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:31.322790 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-704848e8-1214-4d45-a292-9bdbdd0594ee tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.150699 Feb 16 05:36:31.323515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 281/571] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:31 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:31.423759 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:31.431868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:31.433395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:31.434545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9fe7321b-fee9-4514-9034-6940f768a915 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.162578 Feb 16 05:36:31.435106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 291/572] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:31 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:32.339604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:32.340229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:32.346625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:32.347083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:32.347860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:32.348303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:32.452958 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:32.453575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:32.459717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:32.460169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:32.460943 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:32.461429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:32.484293 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:32.492145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b97a3fe0-2dc1-4829-bc8d-d93c83a90860 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.156142 Feb 16 05:36:32.492714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 282/573] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:32 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:32.588677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:32.597675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:32.599112 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:32.600256 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5753e537-639f-49d5-9d2d-5547efd70bce tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.150951 Feb 16 05:36:32.600815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 292/574] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:32 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:33.508819 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:33.509476 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:33.516291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:33.516747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:33.517555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:33.517995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:33.618585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:33.619195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:33.625586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:33.626038 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:33.626828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:33.627265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:33.649445 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:33.657863 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-59c0f1c4-eb33-4c01-a863-190402544245 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.152625 Feb 16 05:36:33.658363 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 283/575] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:33 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:33.768056 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:33.776285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:33.777833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:33.778981 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-258ffa6a-effb-48b8-bbf9-cee9eb09da34 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.164147 Feb 16 05:36:33.779544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 293/576] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:33 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:34.674985 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:34.675604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:34.682376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:34.682818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:34.683599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:34.684034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:34.796667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:34.797283 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:34.803456 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:34.803910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:34.804716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:34.805150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:34.815106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:34.822799 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6c540676-d624-4130-993d-b37bd99bcbc0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.151642 Feb 16 05:36:34.823365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 284/577] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:34 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:34.931916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:34.940542 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:34.942085 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:34.943220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ab1517a1-9f61-4643-b015-22c9d6fdf5a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.150513 Feb 16 05:36:34.943775 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 294/578] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:34 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:35.839690 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:35.840297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:35.847209 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:35.847658 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:35.848427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:35.848860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:35.960962 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:35.961586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:35.967855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:35.968299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:35.969103 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:35.969558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:35.988612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:35.996807 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-254c5b57-ff13-4e98-9a43-cbd2b0696186 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.160717 Feb 16 05:36:35.997418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 285/579] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:35 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:36.114125 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:36.122454 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:36.124457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:36.125671 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-94797b88-ef96-43c6-8296-e16528b648a7 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.168298 Feb 16 05:36:36.126239 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 295/580] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:35 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:37.013893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:37.014457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:37.020683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:37.021134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:37.021941 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:37.022417 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:37.143877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:37.144486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:37.150661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:37.151115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:37.151894 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:37.153072 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:37.154895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:37.163138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ba4d076a-67d4-4122-a304-5efddf22f8c1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.152946 Feb 16 05:36:37.163715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 286/581] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:37 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:37.295172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:37.303871 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:37.305411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:37.306571 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e1d301ba-a65d-4fb9-8ea5-4c2882cee795 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.166981 Feb 16 05:36:37.318297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 296/582] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:37 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:38.180667 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:38.181301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:38.188111 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:38.188564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:38.189372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:38.189813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:38.319921 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:38.325001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:38.325669 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:38.328725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ef0c2c89-6985-412e-922f-b0320e693c77 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.151653 Feb 16 05:36:38.329329 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 287/583] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:38 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:38.332760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:38.333210 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:38.334056 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:38.334485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:38.475176 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:38.483374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:38.484879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:38.486058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3ff6140e-71fc-4a7f-bbe0-1ae3d7a6c422 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.164777 Feb 16 05:36:38.486620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 297/584] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:38 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:39.345818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:39.346454 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:39.352683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:39.353137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:39.353955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:39.354393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:39.503558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:39.504208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:39.510770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:39.511225 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:39.512022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:39.512467 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:39.648579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:39.657516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:39.659017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:39.660168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fddb9085-585d-41b7-afa7-27cf50064bc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.160379 Feb 16 05:36:39.660730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 298/585] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:39 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:36:39.682847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:39.691311 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f4e22a7a-e1bf-48ec-ab76-cfc453d0c270 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.349164 Feb 16 05:36:39.691880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 288/586] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:39 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:40.678873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:40.679571 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:40.685775 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:40.686750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:40.687557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:40.688001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:40.709067 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:40.709652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:40.720987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:40.721504 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:40.722295 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:40.722729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:40.830802 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:40.839174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:40.840674 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:40.842084 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a888b21b-87e4-4dbc-b314-75131d549510 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1751 microversion: 2.20 time: 0.166974 Feb 16 05:36:40.843153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 299/587] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:40 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:40.866699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:40.875050 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e8867bcd-6934-423b-8ecd-8e9aaf6699cd tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1566 microversion: 2.1 time: 0.169799 Feb 16 05:36:40.875607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 289/588] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:40 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:41.860425 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:41.861076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:41.867535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:41.867936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:41.868727 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:41.869167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:41.892191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:41.892955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:41.899535 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:41.900099 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:41.901147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:41.901610 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.038317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:42.047050 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2c67c84f-e400-4628-9307-69c9ab8ba2b6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1546 microversion: 2.1 time: 0.159001 Feb 16 05:36:42.047627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 290/589] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:41 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:42.048498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:42.056861 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:42.059148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:42.060511 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-016e04b8-5539-4128-a990-c1f4db0e163f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.204482 Feb 16 05:36:42.061073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 300/590] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:41 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:42.063445 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:42.063941 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:42.070507 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.071186 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.071980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.072420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.152391 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] HTTP exception thrown: Cannot 'detach_volume' instance 032cece1-a548-4e1f-a72a-b3647d09718c while it is in vm_state rescued Feb 16 05:36:42.152982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Returning 409 to user: Cannot 'detach_volume' instance 032cece1-a548-4e1f-a72a-b3647d09718c while it is in vm_state rescued {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:36:42.153832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ec1f3cc5-34ce-49c7-b7c8-bb58ea1cfc13 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments/bb89719f-1d99-492f-b83e-7f656f5f1d0d" status: 409 len: 152 microversion: 2.1 time: 0.094688 Feb 16 05:36:42.154374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 291/591] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:36:42 2022] DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments/bb89719f-1d99-492f-b83e-7f656f5f1d0d => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 16 05:36:42.163082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:36:42.163661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:42.169732 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.170129 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.172505 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.172972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.235578 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d88bc541-3b90-45ee-bfda-f0ab45bc6a3a tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action" status: 202 len: 0 microversion: 2.1 time: 0.075968 Feb 16 05:36:42.236230 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 301/592] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:36:42 2022] POST /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:36:42.244046 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:42.244653 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:42.251064 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.251511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.252276 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:42.252702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:42.380423 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:42.388148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f2adda21-24f5-4f71-a592-bd8d2f168185 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.147726 Feb 16 05:36:42.388714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 292/593] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:42 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:43.079071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:43.079798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:43.085849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:43.086302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:43.087080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:43.087519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:43.222580 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:43.230848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:43.232355 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:43.234080 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b77d0498-f6c3-4f3a-a6a2-ee3f46a2069a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.159532 Feb 16 05:36:43.234646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 302/594] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:43 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:43.405142 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:43.406354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:43.413134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:43.413617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:43.414401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:43.414838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:43.547229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:43.555069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d7e35651-fc45-4b6b-a9ac-881873a97a62 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.153479 Feb 16 05:36:43.555651 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 293/595] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:43 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:44.252249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:44.252766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:44.258986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:44.259434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:44.260204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:44.260637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:44.392243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:44.400407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:44.401948 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:44.403096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0aa07553-08e8-4f43-9c86-0e5a024ad47d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.155238 Feb 16 05:36:44.403659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 303/596] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:44 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:44.572847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:44.573491 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:44.580858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:44.581530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:44.582312 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:44.582748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:44.782926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:44.791000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2ba35bcc-dc8c-4ca5-ab54-c645023159e6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.222593 Feb 16 05:36:44.791773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 294/597] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:44 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:45.422524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:45.424073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:45.430368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:45.431068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:45.432031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:45.432628 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:45.586792 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:45.594884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:45.596407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:45.597523 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e3846a95-7f26-4162-b690-d10b227a7c4a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.179224 Feb 16 05:36:45.598074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 304/598] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:45 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:45.807780 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:45.808388 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:45.814704 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:45.815153 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:45.815926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:45.816363 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:45.946729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:45.954785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0e1f949e-7f44-4633-8932-5246c086b827 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.150746 Feb 16 05:36:45.955350 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 295/599] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:45 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:46.615111 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:46.615751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:46.622123 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:46.622576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:46.623354 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:46.624326 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:46.754465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:46.762626 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:46.764128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:46.765874 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-296b180d-3d82-4ca5-b9f1-5208dd24586e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.154505 Feb 16 05:36:46.766433 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 305/600] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:46 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:46.971596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:46.972147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:46.978517 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:46.978968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:46.979747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:46.980181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:47.115351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:47.123010 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2cd83f79-418f-4588-ae6f-546496bbc41e tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.155779 Feb 16 05:36:47.124211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 296/601] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:46 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:47.783738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:47.784375 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:47.790649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:47.791096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:47.791862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:47.792295 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:47.946281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:47.956599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:47.958595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:47.960119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cda9dbc7-8eb8-47b2-9fd8-93e1118a6fdb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.180610 Feb 16 05:36:47.960843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 306/602] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:47 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:48.139971 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:48.140772 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:48.147671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:48.148217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:48.149097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:48.149632 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:48.303917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:48.312618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7a19f161-9599-41ba-92e1-d47a4180d89d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.176493 Feb 16 05:36:48.318710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 297/603] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:48 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:48.978576 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:48.979211 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:48.987281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:48.987819 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:48.988712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:48.989223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:49.138119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:49.147143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:49.148947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:49.150386 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-91f418cd-8813-47cf-9c52-ef3d2d24a1e4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.175852 Feb 16 05:36:49.161625 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 307/604] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:48 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:49.330944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:49.331870 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:49.338125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:49.338647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:49.339495 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:49.339995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:49.490210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:49.498202 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-018137fd-0057-4079-bb43-4c79c894a0de tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.172488 Feb 16 05:36:49.499561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 298/605] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:49 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:50.170186 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:50.171649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:50.179693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:50.180172 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:50.181003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:50.181462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:50.325987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:50.334672 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:50.336181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:50.337358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-66aaeb26-9694-4840-a753-b7e2ba0fe430 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.172287 Feb 16 05:36:50.337916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 308/606] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:50 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:50.515840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:50.516453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:50.522810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:50.523260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:50.524040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:50.524524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:50.663223 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:50.675965 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-881a99eb-3c29-43be-909a-87c4a743c7b0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.160650 Feb 16 05:36:50.676598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 299/607] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:50 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:51.355388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:51.355994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:51.362836 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:51.363238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:51.364017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:51.364452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:51.511960 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:51.521366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:51.523048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:51.524397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0e35756b-59c9-42f4-95eb-7123cbac44bb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.172671 Feb 16 05:36:51.524972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 309/608] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:51 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:51.693129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:51.693775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:51.700156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:51.700611 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:51.701427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:51.702725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:51.854918 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:51.863898 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2d58719e-29ad-425e-8f01-af207b9e0363 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.174323 Feb 16 05:36:51.864634 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 300/609] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:51 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:36:52.543726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:52.544473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:52.550549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:52.551297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:52.552277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:52.552717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:52.692016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:52.700661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:52.702268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:52.703568 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4a6989fb-3487-4b6b-902b-b5693009ee25 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.163775 Feb 16 05:36:52.704200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 310/610] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:52 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:52.882642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:52.883302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:52.889624 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:52.890076 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:52.890862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:52.891299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:53.038970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:53.047931 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3b7fe7df-2b59-4610-9911-dba55a02207c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.168871 Feb 16 05:36:53.048510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 301/611] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:52 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:53.721737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:53.722336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:53.728626 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:53.729078 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:53.729890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:53.730326 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:53.878313 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:53.887013 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:53.888533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:53.890332 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-71bcdeae-b2ac-403f-a897-e7f0eff1672a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.172384 Feb 16 05:36:53.890895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 311/612] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:53 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:54.066769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:54.067382 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:54.080784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:54.081226 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:54.082045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:54.082481 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:54.245505 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:54.254033 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f709b30e-292d-4b4b-9fb4-bbc40153a97d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.190847 Feb 16 05:36:54.254818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 302/613] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:54 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:54.909440 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:54.910202 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:54.916462 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:54.916905 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:54.917717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:54.918417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:55.072319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:55.080836 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:55.082379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:55.083545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-afe9911b-5ff8-418a-9787-88fb55209626 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.179125 Feb 16 05:36:55.084115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 312/614] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:54 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:55.271439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:55.272231 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:55.278675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:55.279130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:55.280519 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:55.280964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:55.422043 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:55.430198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-074c30c9-4a5a-4c7c-b7d7-fa9178acc6ca tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.162925 Feb 16 05:36:55.430767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 303/615] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:55 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:56.101541 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:56.102170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:56.109897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:56.110350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:56.111119 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:56.111531 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:56.260266 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:56.271911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:56.273431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:56.274589 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-428ad8a8-185f-4c3c-b3be-585ed0e2195e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.177044 Feb 16 05:36:56.275292 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 313/616] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:56 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:56.447806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:56.448496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:56.455359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:56.455813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:56.456599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:56.457032 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:56.596351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:56.605441 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6188ea34-1f20-4c4f-8abf-502df6657679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.161290 Feb 16 05:36:56.606525 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 304/617] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:56 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:57.292138 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:57.292768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:57.299740 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:57.300184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:57.300945 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:57.301405 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:57.433586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:57.442134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:57.443613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:57.444742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dc1e8e37-0b48-41b7-9e33-75117a291dcf tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.156358 Feb 16 05:36:57.445311 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 314/618] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:57 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:57.625954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:57.627785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:57.635052 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:57.635509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:57.636299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:57.636734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:57.780019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:57.789068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e28bf34f-d494-4b8b-9d95-8671a425bec6 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1554 microversion: 2.1 time: 0.167578 Feb 16 05:36:57.789822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 305/619] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:57 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:58.462933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:58.463575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:58.469830 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.470286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.471061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.471498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.607754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:58.616468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:58.618027 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:58.619181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-06f06863-2743-45a7-833e-c13e64874a41 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.159981 Feb 16 05:36:58.619741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 315/620] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:58 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:36:58.763604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:58.764107 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:58.771005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.771457 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.772233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.772671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.807036 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:58.807649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:58.813971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.814413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.815174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:58.815603 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:58.852297 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lazy-loading 'services' on Instance uuid adc32bbc-43a6-4be6-91fb-c186a02af50c {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:36:58.925805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cf7031c0-6dbc-480f-9fbe-6432c1e07995 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "DELETE /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c/os-volume_attachments/bdfeb4f8-dcab-41cf-84b1-490e75d715a0" status: 202 len: 0 microversion: 2.1 time: 0.165711 Feb 16 05:36:58.926991 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 306/621] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:36:58 2022] DELETE /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c/os-volume_attachments/bdfeb4f8-dcab-41cf-84b1-490e75d715a0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:36:58.973692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:58.999724 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-450dd423-b692-4290-bd44-48094ad6a329 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1560 microversion: 2.1 time: 0.196196 Feb 16 05:36:59.000335 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 316/622] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:36:58 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:36:59.069914 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:59.070301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:59.077597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.078049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.079162 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.079679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.157754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lazy-loading 'services' on Instance uuid 032cece1-a548-4e1f-a72a-b3647d09718c {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:36:59.225345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-882a90b6-6d10-4f0a-9666-8a35bdcb6d50 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments/bb89719f-1d99-492f-b83e-7f656f5f1d0d" status: 202 len: 0 microversion: 2.1 time: 0.159551 Feb 16 05:36:59.226133 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 307/623] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:36:59 2022] DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments/bb89719f-1d99-492f-b83e-7f656f5f1d0d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:36:59.235043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:59.236065 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:59.242656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.243229 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.244079 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.244507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.276614 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a0329e29-020e-41ce-adc8-0f80f669a679 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Feb 16 05:36:59.277304 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 317/624] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:36:59 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:36:59.637576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:36:59.638260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:36:59.644747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.645193 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.645998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:36:59.646428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:36:59.840009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:59.848939 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:59.850550 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:36:59.851688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6dad13bc-8139-4fd5-a2e6-3e27a354457b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.218250 Feb 16 05:36:59.852242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 308/625] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:36:59 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:00.053980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:00.054755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:00.061040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.061670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.062380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.063432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.089411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:37:00.164591 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ea9fc4af-1d08-4e3c-ab6e-856633f2b110 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "DELETE /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 204 len: 0 microversion: 2.1 time: 0.113940 Feb 16 05:37:00.165313 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 318/626] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:37:00 2022] DELETE /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:37:00.174666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:00.175314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:00.181134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.181627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.182411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.182851 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.288831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:00.290074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:00.296408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.296859 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.297684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.298116 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.330240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f681ecc3-d49b-4f07-a5c8-e980457ac35c tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Feb 16 05:37:00.330831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 319/627] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:37:00 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:37:00.385447 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:00.393221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-13d97350-04b7-4cde-86df-15fcb1d0eeef tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1513 microversion: 2.1 time: 0.223331 Feb 16 05:37:00.393819 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 309/628] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:00 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:00.868847 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:00.869663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:00.876274 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.876946 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:00.878020 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:00.878460 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:01.023341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:01.032104 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:01.033638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:01.037657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-474f7b2d-5671-4e18-b18d-55598fb9b3ff tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.169714 Feb 16 05:37:01.037657 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 320/629] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:00 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:37:01.341158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:01.342148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:01.348853 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:01.349345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:01.350112 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:01.350541 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:01.379622 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2022dc21-7518-4711-ac36-e75be95646e1 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042022 Feb 16 05:37:01.380102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 310/630] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:37:01 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:37:01.410043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:01.410653 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:01.418895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:01.419627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:01.420111 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:01.420543 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:01.571634 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:01.578985 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fb8244e5-e221-4bb9-a41c-6fba336dc4de tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1513 microversion: 2.1 time: 0.172590 Feb 16 05:37:01.579561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 321/631] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:01 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:02.053126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:02.053776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:02.059674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:02.060147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:02.060949 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:02.061508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:02.203069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:02.212144 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:02.213702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:02.215053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-601f1476-ed8f-4f7a-b499-feebd097f223 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.165712 Feb 16 05:37:02.215817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 311/632] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:02 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:02.596058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:02.597039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:02.604043 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:02.604704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:02.605929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:02.606696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:02.792558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:02.801632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-18f844a8-05f6-4c01-8cd6-0c5521c293b8 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 200 len: 1513 microversion: 2.1 time: 0.209652 Feb 16 05:37:02.802214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 322/633] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:02 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:02.961999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-883081af-fa91-46db-9be6-09eca308624f req-f40f65b5-a685-4d93-af67-bd209ad206dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc32bbc-43a6-4be6-91fb-c186a02af50c", "name": "network-vif-deleted", "tag": "325b6ba7-382f-4677-8261-a77bd7a69aef"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:02.963555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:02.963555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:37:02.970909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-883081af-fa91-46db-9be6-09eca308624f req-f40f65b5-a685-4d93-af67-bd209ad206dd service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:02.971351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-883081af-fa91-46db-9be6-09eca308624f req-f40f65b5-a685-4d93-af67-bd209ad206dd service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:02.984216 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-883081af-fa91-46db-9be6-09eca308624f req-f40f65b5-a685-4d93-af67-bd209ad206dd service nova] Creating event network-vif-deleted:325b6ba7-382f-4677-8261-a77bd7a69aef for instance adc32bbc-43a6-4be6-91fb-c186a02af50c on hv-cinder-82947 Feb 16 05:37:02.989679 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-883081af-fa91-46db-9be6-09eca308624f req-f40f65b5-a685-4d93-af67-bd209ad206dd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Feb 16 05:37:02.990370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 312/634] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:03.233052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:03.233629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:03.239498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.239943 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.240706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.241139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.374546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:03.389815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:03.391378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:03.392585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c52e552e-561f-4927-bbc4-495a2eeb3038 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.163352 Feb 16 05:37:03.393151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 323/635] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:03 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:03.748388 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:03.748967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:03.754918 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.755367 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.756143 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.756586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.780211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:37:03.819339 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:03.820034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: adc32bbc-43a6-4be6-91fb-c186a02af50c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:03.826140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.826582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.827345 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.827777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.842218 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] HTTP exception thrown: Instance adc32bbc-43a6-4be6-91fb-c186a02af50c could not be found. Feb 16 05:37:03.842830 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Returning 404 to user: Instance adc32bbc-43a6-4be6-91fb-c186a02af50c could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:37:03.843644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6063d33c-ca19-4892-a30b-4e4c4ffa8bb9 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c" status: 404 len: 111 microversion: 2.1 time: 0.028086 Feb 16 05:37:03.844378 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 324/636] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:03 2022] GET /compute/v2.1/servers/adc32bbc-43a6-4be6-91fb-c186a02af50c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:37:03.857396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-27bca299-e5fc-449f-9059-b3f409f7dec0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 204 len: 0 microversion: 2.1 time: 0.112648 Feb 16 05:37:03.858173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 313/637] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:37:03 2022] DELETE /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:37:03.866159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:03.866964 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:03.872864 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.873376 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:03.874162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:03.874599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:04.023942 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:04.031986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-379b08b1-3429-4d6a-b874-6f4c85b4e5a9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1506 microversion: 2.1 time: 0.169377 Feb 16 05:37:04.032650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 325/638] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:03 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:04.411490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:04.412169 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:04.418586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:04.419029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:04.419804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:04.420290 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:04.551364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:04.559956 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:04.561514 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:04.563269 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-404f25f5-7a9d-4d5a-820e-adfaa6bf53ac tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.155256 Feb 16 05:37:04.564130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 314/639] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:04 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:05.052956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:05.053581 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:05.059852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:05.060302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:05.061073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:05.061534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:05.206297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:05.213599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-66da7dfc-4d30-4392-bbc4-9483850e0ba3 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1506 microversion: 2.1 time: 0.164237 Feb 16 05:37:05.214166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 326/640] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:05 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:05.582042 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:05.582753 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:05.589859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:05.590320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:05.591080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:05.591517 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:05.759155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:05.767808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:05.769515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:05.770890 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4d1a5f30-5741-43dd-b7a6-713734fbab9a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.193239 Feb 16 05:37:05.771553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 315/641] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:05 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:06.230973 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:06.231535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:06.239010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:06.239679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:06.240676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:06.241117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:06.387963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:06.395258 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3da53c4a-afbf-4e0f-86e7-b0baf658629d tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1506 microversion: 2.1 time: 0.168163 Feb 16 05:37:06.395818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 327/642] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:06 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:06.788858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:06.789575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:06.796512 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:06.797674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:06.798528 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:06.799037 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:06.949876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:06.958924 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:06.960567 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:06.962000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-122ae24b-3dbe-4152-90a7-9a45dcaeaeb5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.176778 Feb 16 05:37:06.962788 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 316/643] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:06 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:07.254803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:07.255579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:07.261676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.262197 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:07.263055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.263557 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:07.347834 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lazy-loading 'services' on Instance uuid e7bbecd5-0b2b-42ad-905e-cff757d16934 {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:37:07.413896 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:07.414777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:07.422048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-25e9714b-d926-41fa-830c-7db61e7262bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments/a86afd52-602d-4c30-a0ac-1060bb575323" status: 202 len: 0 microversion: 2.1 time: 0.171640 Feb 16 05:37:07.423084 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 328/644] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:37:07 2022] DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments/a86afd52-602d-4c30-a0ac-1060bb575323 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 05:37:07.424736 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.425199 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:07.426261 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.426703 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:07.585807 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:07.593305 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6647f468-a3d0-4bcb-8db0-1f03b7e37304 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1506 microversion: 2.1 time: 0.183671 Feb 16 05:37:07.594072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 317/645] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:07 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:07.989074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:07.989793 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:07.996037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.996485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:07.997285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:07.997725 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:08.215158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:08.230748 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:08.232318 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:08.233623 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-52200506-b8a6-410d-821e-b961a67ecc35 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.249133 Feb 16 05:37:08.234714 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 329/646] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:07 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:08.300213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-1f9f5ebe-5a53-492d-8c57-b4c36b996a38 req-95676e66-6b69-49f6-87fe-6c2406a22237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f32b7e4-79a4-47f9-ab79-2d74d3b26190", "name": "network-vif-deleted", "tag": "beeb43e2-2312-4e25-8fef-fd7ecfc5800b"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:08.303612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:08.303612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:37:08.314266 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1f9f5ebe-5a53-492d-8c57-b4c36b996a38 req-95676e66-6b69-49f6-87fe-6c2406a22237 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:08.314488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1f9f5ebe-5a53-492d-8c57-b4c36b996a38 req-95676e66-6b69-49f6-87fe-6c2406a22237 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:08.332320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-1f9f5ebe-5a53-492d-8c57-b4c36b996a38 req-95676e66-6b69-49f6-87fe-6c2406a22237 service nova] Creating event network-vif-deleted:beeb43e2-2312-4e25-8fef-fd7ecfc5800b for instance 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 on hv-cinder-82947 Feb 16 05:37:08.338887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-1f9f5ebe-5a53-492d-8c57-b4c36b996a38 req-95676e66-6b69-49f6-87fe-6c2406a22237 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046346 Feb 16 05:37:08.339915 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 318/647] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:08.610343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:08.610885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:08.617161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:08.617650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:08.618428 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:08.618862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:08.648815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:08.649280 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:08.649739 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lazy-loading 'fault' on Instance uuid 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:37:08.688157 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:08.695358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9336a47f-573d-4bfd-94cd-a3d265ad34ae tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 200 len: 1311 microversion: 2.1 time: 0.088750 Feb 16 05:37:08.695918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 330/648] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:08 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:09.252590 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:09.253305 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:09.259394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.260018 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.260866 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.261403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.400770 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:09.411886 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:09.413776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:09.415004 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-933c5492-640c-4633-993c-1078c6085c2b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.167010 Feb 16 05:37:09.415564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 319/649] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:09 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:09.598726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-256eee15-8a07-46be-8d85-56ccea70a4ef tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:09.605031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-256eee15-8a07-46be-8d85-56ccea70a4ef tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.605680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-256eee15-8a07-46be-8d85-56ccea70a4ef tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.665435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-256eee15-8a07-46be-8d85-56ccea70a4ef tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Going to try to stop instance {{(pid=122878) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 16 05:37:09.712940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-256eee15-8a07-46be-8d85-56ccea70a4ef tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action" status: 202 len: 0 microversion: 2.1 time: 0.124171 Feb 16 05:37:09.713731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:09.714387 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 331/650] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:37:09 2022] POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:37:09.714705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 4f32b7e4-79a4-47f9-ab79-2d74d3b26190] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:09.721317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.722023 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.722829 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.723259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.730852 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:09.731645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:09.737141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] HTTP exception thrown: Instance 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 could not be found. Feb 16 05:37:09.737766 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Returning 404 to user: Instance 4f32b7e4-79a4-47f9-ab79-2d74d3b26190 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:37:09.738471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.738607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5f496247-f6ba-4149-a9a5-c03c426294d4 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190" status: 404 len: 111 microversion: 2.1 time: 0.029469 Feb 16 05:37:09.738921 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.742189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 320/651] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:09 2022] GET /compute/v2.1/servers/4f32b7e4-79a4-47f9-ab79-2d74d3b26190 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:37:09.742341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.742341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.746922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:09.747411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:09.753369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.753827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.754604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.755038 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.783527 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:37:09.872647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2cc8efe3-365d-4d3a-9cd0-4bee7dc0a7e9 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 204 len: 0 microversion: 2.1 time: 0.128923 Feb 16 05:37:09.873539 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 321/652] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:37:09 2022] DELETE /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:37:09.883223 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:09.884018 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:09.888518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:09.890100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.890612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.891401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:09.891832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:09.896297 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-63a7fb6a-d497-484e-af22-fee67cece2fa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.169722 Feb 16 05:37:09.896951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 332/653] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:09 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:10.027821 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:10.035676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1ab3641d-253e-4b09-8b31-5959da3ffdb0 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.156971 Feb 16 05:37:10.036249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 322/654] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:09 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:10.438561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:10.439167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:10.445005 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:10.445496 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:10.446275 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:10.446720 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:10.584947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:10.593160 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:10.594809 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:10.595959 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0c74b1b9-38a9-4b05-af72-4f315849ef6a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.161721 Feb 16 05:37:10.596521 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 333/655] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:10 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:37:10.912823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:10.913482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:10.920150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:10.920596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:10.921437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:10.922453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:11.051695 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:11.052803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:11.053451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:11.059075 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7e463552-d2c7-430e-a47f-d91c6f466696 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.149897 Feb 16 05:37:11.059613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:11.059743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 323/656] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:10 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:11.060076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:11.060865 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:11.061338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:11.191214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:11.198500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-456c7b02-60c2-417c-8565-d7c9cbc47f20 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.149363 Feb 16 05:37:11.199070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 334/657] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:11 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:11.613273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:11.613902 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:11.619664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:11.620106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:11.620862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:11.621311 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:11.754991 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:11.763793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:11.765943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:11.767989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-98697312-7f7e-4edf-b5cc-892195eea254 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.158099 Feb 16 05:37:11.769005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 324/658] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:11 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:12.077513 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:12.078770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:12.084970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.085459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.086228 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.086661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.214946 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:12.215427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:12.215541 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:12.222237 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.222683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.223101 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5aa5096f-6e77-4ec9-8325-a0a0a24bb93f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.149196 Feb 16 05:37:12.223451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.223674 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 335/659] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:12 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:12.223888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.354563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:12.364911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e45b4a1e-6e7d-4db4-9a0a-c224cd575992 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.153541 Feb 16 05:37:12.366635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 325/660] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:12 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:12.617183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-92fca53b-2b96-45ae-b626-b596bf204db2 req-d59343ad-5292-49d3-8a52-50a6900c9bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "name": "network-vif-plugged", "status": "completed", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:12.619016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:12.619016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:37:12.626732 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-92fca53b-2b96-45ae-b626-b596bf204db2 req-d59343ad-5292-49d3-8a52-50a6900c9bf3 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.627316 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-92fca53b-2b96-45ae-b626-b596bf204db2 req-d59343ad-5292-49d3-8a52-50a6900c9bf3 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.639719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-92fca53b-2b96-45ae-b626-b596bf204db2 req-d59343ad-5292-49d3-8a52-50a6900c9bf3 service nova] Creating event network-vif-plugged:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:37:12.645579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-92fca53b-2b96-45ae-b626-b596bf204db2 req-d59343ad-5292-49d3-8a52-50a6900c9bf3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Feb 16 05:37:12.646277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 336/661] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:37:12.786156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-873933988", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "networks": [{"uuid": "004f2655-6cbe-4c49-9f60-896ff03daa11"}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:12.788943 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:12.789924 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:12.798393 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.799188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.800379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:12.801044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:12.844459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] validate_networks() for [('004f2655-6cbe-4c49-9f60-896ff03daa11', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:37:12.954380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:12.962646 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:12.964144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:12.965319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c57f33be-d225-4a30-939f-d3b7a3f712ec tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.180440 Feb 16 05:37:12.965890 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 337/662] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:12 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:37:13.240408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:13.241202 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:13.256601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.257058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.259863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.260312 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.383813 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:37:13.384291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:37:13.384823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:37:13.385581 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:37:13.386164 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:37:13.397633 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.398353 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.399366 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.399998 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.418148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Getting quotas for project a642dcc1cb8a4c1bbd3b1450e060c74c. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:37:13.425917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Getting quotas for user ae34f18423784b6d9e9bd45f2fa796e2 and project a642dcc1cb8a4c1bbd3b1450e060c74c. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:37:13.442365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:37:13.444899 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:37:13.455990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:13.463395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-630976cb-5e91-4e84-a34f-d06157d9208a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.226595 Feb 16 05:37:13.464823 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 338/663] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:13 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:13.477347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:13.478118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:13.485837 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.486483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.487276 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.488028 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.502926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-21ecd3a6-50c2-48e5-868d-c3cdc0bf289c tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720451 Feb 16 05:37:13.503569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 326/664] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:37:13.513065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0f5214e8-ee15-485c-89c2-483ead1a10f5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:13.513867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0f5214e8-ee15-485c-89c2-483ead1a10f5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:13.571714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0f5214e8-ee15-485c-89c2-483ead1a10f5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:13.578883 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0f5214e8-ee15-485c-89c2-483ead1a10f5 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1218 microversion: 2.1 time: 0.068761 Feb 16 05:37:13.581359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 327/665] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:13 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:13.666718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:13.676384 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-058d3a26-eeb9-45cc-9e5d-8400600f2f88 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.210439 Feb 16 05:37:13.676903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 339/666] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:13 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:13.984680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:13.985350 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:13.992480 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.993028 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:13.993919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:13.994430 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.242943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.253562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.255435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.256688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1bb88c8b-7ece-4b47-9bb4-78c58e65d740 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.275767 Feb 16 05:37:14.257383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 328/667] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:13 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:14.482158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:14.483472 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:14.489751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.490409 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.491201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.491640 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.596549 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:14.597803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:14.604190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.604640 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.605459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.605887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.629807 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.639219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-aa725861-1725-4f7e-a5cf-05df69880360 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.161702 Feb 16 05:37:14.639975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 340/668] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:14 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:14.676403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.684906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f186e6c1-e7c1-450e-a18c-65e63dd148db tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1270 microversion: 2.1 time: 0.092857 Feb 16 05:37:14.685840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 329/669] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:14 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:14.699732 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:14.700350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:14.706872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.707333 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.708438 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:14.708878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:14.872549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:14.881250 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d416a61d-7a4a-4172-abcd-e8fa0574d194 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.185683 Feb 16 05:37:14.881850 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 341/670] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:14 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:15.274953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:15.275575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:15.282538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.282997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.283789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.284227 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.644817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:15.656840 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:15.657536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:15.657829 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:15.660634 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:15.662100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e1400181-1760-4e67-b056-823e0f4ccd62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1807 microversion: 2.20 time: 0.390992 Feb 16 05:37:15.662993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 330/671] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:15 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1807 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:15.680848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.686698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.688130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.688577 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.708727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:15.709496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:15.717933 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.719524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.721171 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.721861 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.885613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:15.894265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-407ce626-471b-4a89-bcaa-6524a4e17c93 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.241257 Feb 16 05:37:15.895030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 342/672] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:15 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:15.909035 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:15.909922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:15.916418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.917070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.918328 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:15.919026 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:15.944847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:15.966160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-19102880-b142-493a-a183-4a431b46b55b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.260787 Feb 16 05:37:15.970860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 331/673] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:15 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:16.080549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:16.090008 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f9e2c9d8-7759-42e9-8de5-ffb211962f68 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.184529 Feb 16 05:37:16.090684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 343/674] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:15 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:16.537552 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-1c642198-664f-4c71-a09c-ad9366eddc64 req-9f1de561-2785-4d16-a2f5-1d4fd256bc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1bed7f-b18f-4923-bcfa-be8143014b1c", "tag": "eba8ae14-c129-4b5a-9057-7ed36c28f17f"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:16.539838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:16.539838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:37:16.550346 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1c642198-664f-4c71-a09c-ad9366eddc64 req-9f1de561-2785-4d16-a2f5-1d4fd256bc5f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.550811 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1c642198-664f-4c71-a09c-ad9366eddc64 req-9f1de561-2785-4d16-a2f5-1d4fd256bc5f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.570675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-1c642198-664f-4c71-a09c-ad9366eddc64 req-9f1de561-2785-4d16-a2f5-1d4fd256bc5f service nova] Creating event network-changed:eba8ae14-c129-4b5a-9057-7ed36c28f17f for instance 8b1bed7f-b18f-4923-bcfa-be8143014b1c on hv-cinder-82947 Feb 16 05:37:16.576224 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-1c642198-664f-4c71-a09c-ad9366eddc64 req-9f1de561-2785-4d16-a2f5-1d4fd256bc5f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049283 Feb 16 05:37:16.577418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 332/675] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:16.680940 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:16.681935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:16.688889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.689454 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.690314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.690831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.842920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:16.851564 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:16.853712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:16.854922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-17cbc321-c0c7-4683-ab72-5ee5a9aa935f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1794 microversion: 2.20 time: 0.177277 Feb 16 05:37:16.869068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 344/676] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:37:16 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1794 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:37:16.912034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:16.912729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:16.919264 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.919938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.920719 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.921150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.986545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:16.987153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:16.993299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.993727 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:16.994506 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:16.994934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:17.117205 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:17.125582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-98ae991f-2c1d-471b-bcd8-77f9b8d5b873 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.217425 Feb 16 05:37:17.126255 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 333/677] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:16 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:17.130945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:17.131767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:17.137797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:17.138481 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:17.139353 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:17.139754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:17.141035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:17.147892 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a0ce997b-be86-4d73-bfa9-90974ab2f017 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.165230 Feb 16 05:37:17.148728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 345/678] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:16 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:17.353819 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:17.361795 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f3798e5b-4b7c-4112-8635-581d4a05d872 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.234360 Feb 16 05:37:17.362378 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 334/679] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:17 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:18.142757 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:18.143941 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:18.150204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.150662 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.151452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.151897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.165608 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:18.166353 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:18.174054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.174706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.175866 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.176452 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.290500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:18.299680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ae5bedc4-ee2e-40b7-b8c5-7b9d85b3712c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.161260 Feb 16 05:37:18.310372 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 346/680] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:18 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:18.351051 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:18.358713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ba1538cf-d1da-4015-810e-387ca4b396d4 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.197021 Feb 16 05:37:18.359343 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 335/681] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:18 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:18.379930 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:18.380538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:18.386242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.386684 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.387754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:18.388197 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:18.531590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:18.538951 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-682420d6-91a4-4a4f-aacf-880aaa420f56 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.162725 Feb 16 05:37:18.539629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 347/682] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:18 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:19.315766 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:19.316374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:19.322586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.323040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.323822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.324262 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.375068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:19.375813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:19.382231 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.382687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.383458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.383901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.465715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:19.473502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-78229913-8661-420c-b2bd-05a50eb02650 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.161355 Feb 16 05:37:19.474085 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 336/683] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:19 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:19.543255 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:19.552447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-992777d4-a6e9-4108-ba26-996f7a16f856 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.180279 Feb 16 05:37:19.556484 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:19.557181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:19.561463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 348/684] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:19 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:19.563780 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.564235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.565031 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:19.565510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:19.706400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:19.715549 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-74aadcf4-2fa6-4bc2-8aba-f86e0e3ec2b2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.162758 Feb 16 05:37:19.716128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 337/685] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:19 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:20.490922 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:20.491631 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:20.498030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.498549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.499400 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.499910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.568257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:20.569490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:20.576403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.577069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.578633 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.579502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.740567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:20.754758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f8628310-24fe-4079-8028-becd9600c038 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.267488 Feb 16 05:37:20.755490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 349/686] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:20 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:20.767647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:20.768536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:20.775295 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.776253 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.777534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:20.778082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:20.810073 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:20.821596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-40f3eed3-a65c-44d5-8229-c9ffed6586ae tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.256875 Feb 16 05:37:20.822286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 338/687] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:20 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:20.930356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e83de12959394ba5a75f5881741540a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971394cccbfa49b584616f61ed5eb8a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:20.939123 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3fcb60e8-c8c6-46ab-8abd-4bc6475aefd2 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 200 len: 1520 microversion: 2.1 time: 0.182267 Feb 16 05:37:20.940372 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 350/688] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:20 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:21.106987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-fa8ed102-19ec-4a70-9e38-c4c3d6a8045a req-2d70c24d-88c8-42b3-99f8-2304fcd1a9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032cece1-a548-4e1f-a72a-b3647d09718c", "name": "network-vif-deleted", "tag": "b086e2fa-4423-4f0a-ab73-6efbf20ec756"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:21.112128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:21.112128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:37:21.126273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-fa8ed102-19ec-4a70-9e38-c4c3d6a8045a req-2d70c24d-88c8-42b3-99f8-2304fcd1a9e7 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.127002 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-fa8ed102-19ec-4a70-9e38-c4c3d6a8045a req-2d70c24d-88c8-42b3-99f8-2304fcd1a9e7 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.141189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-fa8ed102-19ec-4a70-9e38-c4c3d6a8045a req-2d70c24d-88c8-42b3-99f8-2304fcd1a9e7 service nova] Creating event network-vif-deleted:b086e2fa-4423-4f0a-ab73-6efbf20ec756 for instance 032cece1-a548-4e1f-a72a-b3647d09718c on hv-cinder-82947 Feb 16 05:37:21.149952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-fa8ed102-19ec-4a70-9e38-c4c3d6a8045a req-2d70c24d-88c8-42b3-99f8-2304fcd1a9e7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050964 Feb 16 05:37:21.150947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 339/689] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:21.771783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:21.772397 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:21.778189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.778648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.779433 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.779883 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.840070 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:21.841184 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:21.849599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.850338 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.851688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.852327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.922654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:21.930418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7a232024-9da6-4040-9632-2be790988f6c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.162453 Feb 16 05:37:21.932572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 351/690] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:21 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:21.956612 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:21.957182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] [instance: 032cece1-a548-4e1f-a72a-b3647d09718c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:21.964934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.965596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.966489 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:21.967181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:21.982407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] HTTP exception thrown: Instance 032cece1-a548-4e1f-a72a-b3647d09718c could not be found. Feb 16 05:37:21.983137 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] Returning 404 to user: Instance 032cece1-a548-4e1f-a72a-b3647d09718c could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:37:21.984734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-acf3563c-2001-49ad-8cac-c618457b5811 tempest-ServerRescueNegativeTestJSON-1373897310 tempest-ServerRescueNegativeTestJSON-1373897310-project] 10.222.0.75 "GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c" status: 404 len: 111 microversion: 2.1 time: 0.032025 Feb 16 05:37:21.988700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 352/691] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:21 2022] GET /compute/v2.1/servers/032cece1-a548-4e1f-a72a-b3647d09718c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:37:22.009216 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:22.018927 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-812eee81-aa4b-4e64-9188-bbe313657e1e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.183576 Feb 16 05:37:22.025365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 340/692] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:21 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:22.722688 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-d64c4159-d8b7-41ea-85f8-5ff46b9dd7f9 req-067df430-54f0-4499-be6a-3cff507a0b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1bed7f-b18f-4923-bcfa-be8143014b1c", "name": "network-vif-plugged", "status": "completed", "tag": "eba8ae14-c129-4b5a-9057-7ed36c28f17f"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:22.725014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:22.725014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:37:22.739219 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d64c4159-d8b7-41ea-85f8-5ff46b9dd7f9 req-067df430-54f0-4499-be6a-3cff507a0b66 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:22.740048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d64c4159-d8b7-41ea-85f8-5ff46b9dd7f9 req-067df430-54f0-4499-be6a-3cff507a0b66 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:22.752459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-d64c4159-d8b7-41ea-85f8-5ff46b9dd7f9 req-067df430-54f0-4499-be6a-3cff507a0b66 service nova] Creating event network-vif-plugged:eba8ae14-c129-4b5a-9057-7ed36c28f17f for instance 8b1bed7f-b18f-4923-bcfa-be8143014b1c on hv-cinder-82947 Feb 16 05:37:22.757608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-d64c4159-d8b7-41ea-85f8-5ff46b9dd7f9 req-067df430-54f0-4499-be6a-3cff507a0b66 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040628 Feb 16 05:37:22.758214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 353/693] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:22.949382 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:22.950713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:22.958023 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:22.958737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:22.959605 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:22.960309 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:23.036667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:23.037734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:23.044379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:23.044923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:23.045884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:23.047257 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:23.140680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:23.149397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-36f3b32e-5fd6-4a80-9d0d-46c2e150148f tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.203406 Feb 16 05:37:23.150487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 341/694] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:22 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:23.266782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:23.274293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ac972073-2c65-4341-b814-c88e32afab4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.243030 Feb 16 05:37:23.274876 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 354/695] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:23 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:24.170515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:24.171804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:24.188042 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:24.188496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:24.189875 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:24.190318 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:24.290670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:24.291273 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:24.298842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:24.299283 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:24.300247 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:24.300840 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:24.462307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:24.471016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ccb44b47-bc97-4747-ba24-bf0d4143cf54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.306992 Feb 16 05:37:24.471826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 342/696] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:24 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:24.483514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:24.494466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-889b156f-1fc0-41fe-a8e5-644d010d3e0e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1318 microversion: 2.1 time: 0.207073 Feb 16 05:37:24.495241 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 355/697] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:24 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:25.487691 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:25.488347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:25.494529 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.495089 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.495748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.496188 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.518294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:25.518294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:25.523545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.524002 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.524794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.525236 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.685180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:25.692650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-36a41efd-c82c-40b7-9b91-7542a77b5b88 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1507 microversion: 2.1 time: 0.181121 Feb 16 05:37:25.704319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 356/698] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:25 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:37:25.709166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c16a0105-77ea-4099-aa4d-b0759bafc4e5", "device": "/dev/sdb"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:25.710435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:25.711750 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:25.717134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.717616 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.719633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:25.720101 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:25.723914 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-6e0ddfdf-bdf1-47c4-8d20-dfd8b3b7f908 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.239754 Feb 16 05:37:25.724513 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 343/699] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:25 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:26.023929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-61a54872-e3df-402e-b956-67955e6dca92 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "POST /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318211 Feb 16 05:37:26.028550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 357/700] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:37:25 2022] POST /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:26.741108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:26.741744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:26.748444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:26.749219 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:26.750618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:26.751140 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:26.893973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:26.901280 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9f0b42ce-e3f2-4cf6-a764-f8ab54b8ea5e tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1676 microversion: 2.1 time: 0.163879 Feb 16 05:37:26.901842 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 344/701] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:26 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:27.919396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:27.920079 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:27.926583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:27.927011 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:27.927778 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:27.928208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:28.067608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:28.074899 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fe5a89f0-3bcb-4f69-a806-21b0519fb632 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1653 microversion: 2.1 time: 0.160303 Feb 16 05:37:28.075463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 358/702] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:27 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:28.090815 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-86d54972-85ec-4875-8079-e269785b348d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:28.098481 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86d54972-85ec-4875-8079-e269785b348d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:28.098987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-86d54972-85ec-4875-8079-e269785b348d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:28.121893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-86d54972-85ec-4875-8079-e269785b348d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Going to try to start instance {{(pid=122879) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 16 05:37:28.164622 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-86d54972-85ec-4875-8079-e269785b348d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action" status: 202 len: 0 microversion: 2.1 time: 0.077187 Feb 16 05:37:28.165152 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 345/703] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:37:28 2022] POST /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:37:28.174260 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:28.175318 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:28.181876 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:28.182860 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:28.183970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:28.184554 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:28.243100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8e31face-057b-47d4-8e1e-f65a61b75570 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc5915a7670>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:28.294285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8e31face-057b-47d4-8e1e-f65a61b75570 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/69183553-c1d2-4246-b85a-dc7e60666ff2" status: 200 len: 351 microversion: 2.1 time: 0.055370 Feb 16 05:37:28.294892 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 346/704] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:37:28 2022] GET /compute/v2.1/os-volumes/69183553-c1d2-4246-b85a-dc7e60666ff2 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:37:28.341424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:28.349958 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-46624e8d-8970-47d1-9ef1-fa2e3cab9dd3 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1662 microversion: 2.1 time: 0.179998 Feb 16 05:37:28.350569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 359/705] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:28 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:29.367566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:29.368407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:29.375014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:29.375473 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:29.376246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:29.376678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:29.523487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:29.530919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f553a999-5c23-437b-9884-a79d8b444ffa tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1666 microversion: 2.1 time: 0.167502 Feb 16 05:37:29.531490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 347/706] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:29 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:29.630585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b30603aa-d2e1-499e-a2e7-9255c6cbc57f tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc591dbe8b0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:29.678723 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b30603aa-d2e1-499e-a2e7-9255c6cbc57f tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/2dbdc34c-3f6f-4f2d-9949-513b83e4a9d9" status: 200 len: 351 microversion: 2.1 time: 0.051641 Feb 16 05:37:29.679299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 360/707] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:37:29 2022] GET /compute/v2.1/os-volumes/2dbdc34c-3f6f-4f2d-9949-513b83e4a9d9 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:30.988126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a57f46ab-9b89-4712-b4f7-3550e2b8bc89 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc59174b1f0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.035124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a57f46ab-9b89-4712-b4f7-3550e2b8bc89 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/a64317de-b91a-497b-b0ab-a98bcfb072d6" status: 200 len: 351 microversion: 2.1 time: 0.050441 Feb 16 05:37:31.035693 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 348/708] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:37:30 2022] GET /compute/v2.1/os-volumes/a64317de-b91a-497b-b0ab-a98bcfb072d6 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:31.048083 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-05910e8b-8ce7-4bd2-9567-cc24b911d2cd tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc59622b0d0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.126729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-05910e8b-8ce7-4bd2-9567-cc24b911d2cd tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.083304 Feb 16 05:37:31.127307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 361/709] 10.222.0.75 () {58 vars in 1133 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:31.138967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-fcaa54f5-9e4b-458d-8dc4-d41d4c6565c8 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc5916ae3a0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.219426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-fcaa54f5-9e4b-458d-8dc4-d41d4c6565c8 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083861 Feb 16 05:37:31.219999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 349/710] 10.222.0.75 () {58 vars in 1148 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:31.231414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-290c5d93-e166-4dda-adee-80c56bbb4fa9 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc59622bca0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.313133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-290c5d93-e166-4dda-adee-80c56bbb4fa9 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085168 Feb 16 05:37:31.313747 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 362/711] 10.222.0.75 () {58 vars in 1133 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:31.325838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ab64e7f6-bfbf-49e1-a45e-e8fcfffcba3f tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc591552a60>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.403725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ab64e7f6-bfbf-49e1-a45e-e8fcfffcba3f tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081463 Feb 16 05:37:31.404307 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 350/712] 10.222.0.75 () {58 vars in 1166 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:31.416549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dcfec8ed-91e3-40b0-ac89-b8647f5bf9be tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc596223040>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.493972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dcfec8ed-91e3-40b0-ac89-b8647f5bf9be tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.080871 Feb 16 05:37:31.494549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 363/713] 10.222.0.75 () {58 vars in 1169 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:31.506208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9f9867a1-8332-415d-bfab-9b5811768908 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc5915520d0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.585989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9f9867a1-8332-415d-bfab-9b5811768908 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083239 Feb 16 05:37:31.586631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 351/714] 10.222.0.75 () {58 vars in 1154 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:31.597725 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a74c855f-a741-49d1-b481-407bddaa603d tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc591da0e50>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.678154 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a74c855f-a741-49d1-b481-407bddaa603d tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083808 Feb 16 05:37:31.678842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 364/715] 10.222.0.75 () {58 vars in 1187 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:31.690487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cf9dcd81-d320-4267-a49a-7c7b70f854d2 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] Calling method '.version_select at 0x7fc5914de700>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:31.769390 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cf9dcd81-d320-4267-a49a-7c7b70f854d2 tempest-VolumesTestJSON-841913396 tempest-VolumesTestJSON-841913396-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082900 Feb 16 05:37:31.769963 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 352/716] 10.222.0.75 () {58 vars in 1154 bytes} [Wed Feb 16 05:37:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:48.336794 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:48.337349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:48.344178 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:48.344438 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:48.345214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:48.345687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:48.439671 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lazy-loading 'services' on Instance uuid 8b1bed7f-b18f-4923-bcfa-be8143014b1c {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:37:48.510569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-02346115-424a-4aea-94c1-66107386bc4e tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c/os-volume_attachments/c16a0105-77ea-4099-aa4d-b0759bafc4e5" status: 202 len: 0 microversion: 2.1 time: 0.177731 Feb 16 05:37:48.511171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 365/717] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:37:48 2022] DELETE /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c/os-volume_attachments/c16a0105-77ea-4099-aa4d-b0759bafc4e5 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:37:52.768898 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:52.769436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:52.775729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:52.776181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:52.776951 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:52.777428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:52.800657 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:37:52.877604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ceac4e4d-0db1-4125-9933-ab3b5895a725 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 204 len: 0 microversion: 2.1 time: 0.112990 Feb 16 05:37:52.878316 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 353/718] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:37:52 2022] DELETE /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:37:52.887356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:52.888050 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:52.894716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:52.895168 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:52.895934 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:52.896370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:53.028604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:53.036105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-54d7205e-11f1-4b8b-993f-1321c0cb6c22 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1513 microversion: 2.1 time: 0.153295 Feb 16 05:37:53.036669 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 366/719] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:52 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:54.054617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:54.055532 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:54.062467 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:54.062919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:54.063700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:54.064136 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:54.254915 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:54.262737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-523ce0bf-26e8-4014-8e7c-752de71d3909 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1513 microversion: 2.1 time: 0.212118 Feb 16 05:37:54.263213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 354/720] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:54 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:55.279774 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:55.280468 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:55.286636 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:55.287087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:55.287877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:55.294130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:55.443838 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:55.452481 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4a3d5fee-3609-406a-9388-dc09fdaaa712 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1513 microversion: 2.1 time: 0.176372 Feb 16 05:37:55.453057 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 367/721] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:55 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:56.469573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:56.471114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:56.477822 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:56.478282 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:56.479152 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:56.479587 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:56.700561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:56.711440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-efb7296d-ef51-4a47-8bd8-c45cec882e2a tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1513 microversion: 2.1 time: 0.245914 Feb 16 05:37:56.712208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 355/722] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:56 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:57.660207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-5514fe4f-1124-4a81-a3ac-f16449bd0b55 req-860edb3e-de37-41e5-81ff-b2f441d30303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1bed7f-b18f-4923-bcfa-be8143014b1c", "name": "network-vif-deleted", "tag": "eba8ae14-c129-4b5a-9057-7ed36c28f17f"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:37:57.661610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:37:57.661610 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:37:57.669240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-5514fe4f-1124-4a81-a3ac-f16449bd0b55 req-860edb3e-de37-41e5-81ff-b2f441d30303 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:57.669697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-5514fe4f-1124-4a81-a3ac-f16449bd0b55 req-860edb3e-de37-41e5-81ff-b2f441d30303 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:57.682040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-5514fe4f-1124-4a81-a3ac-f16449bd0b55 req-860edb3e-de37-41e5-81ff-b2f441d30303 service nova] Creating event network-vif-deleted:eba8ae14-c129-4b5a-9057-7ed36c28f17f for instance 8b1bed7f-b18f-4923-bcfa-be8143014b1c on hv-cinder-82947 Feb 16 05:37:57.687770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-5514fe4f-1124-4a81-a3ac-f16449bd0b55 req-860edb3e-de37-41e5-81ff-b2f441d30303 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031214 Feb 16 05:37:57.688401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 368/723] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:37:57.731160 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:57.731731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:57.738256 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:57.738648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:57.739432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:57.739925 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:57.806746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae34f18423784b6d9e9bd45f2fa796e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:37:57.814980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e46432e6-deaf-4a1a-a63a-85b28c3ceca2 tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 200 len: 1303 microversion: 2.1 time: 0.088068 Feb 16 05:37:57.815927 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 356/724] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:57 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:37:58.832963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:37:58.833813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] [instance: 8b1bed7f-b18f-4923-bcfa-be8143014b1c] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:37:58.839924 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:58.840375 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:58.841205 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:37:58.841650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:37:58.855066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] HTTP exception thrown: Instance 8b1bed7f-b18f-4923-bcfa-be8143014b1c could not be found. Feb 16 05:37:58.855652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] Returning 404 to user: Instance 8b1bed7f-b18f-4923-bcfa-be8143014b1c could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:37:58.856457 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1589c79b-33ae-4641-a39e-9972eef2a56b tempest-VolumesSnapshotTestJSON-725376803 tempest-VolumesSnapshotTestJSON-725376803-project] 10.222.0.75 "GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c" status: 404 len: 111 microversion: 2.1 time: 0.027910 Feb 16 05:37:58.857026 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 369/725] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:37:58 2022] GET /compute/v2.1/servers/8b1bed7f-b18f-4923-bcfa-be8143014b1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:38:04.195064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:38:04.195713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:38:15.214185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:15.215091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:15.221875 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.222335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.223096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.223522 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.251778 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5cd56052-0418-40f6-b82d-576be618ca95 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041268 Feb 16 05:38:15.252318 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 357/726] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:38:15 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:38:15.306563 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:15.307105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:15.313959 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.314296 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.315082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.315508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.343217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:38:15.420675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-795b055b-6c9a-42b8-a0c3-1985577e86a9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 204 len: 0 microversion: 2.1 time: 0.116888 Feb 16 05:38:15.424813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 370/727] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:38:15 2022] DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:38:15.430387 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:15.431002 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:15.437141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.437690 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.438494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.438930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.725246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:15.726173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:15.732586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.733038 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.733848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.734283 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.741440 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:15.749510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c1439a50-b323-47d5-897e-03ef2b1ce573 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1672 microversion: 2.1 time: 0.323226 Feb 16 05:38:15.750559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 358/728] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:15 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1672 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:15.772478 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e2d9e68d-ca56-4e34-9cb6-ba85dc528cbc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments/7b0330ca-3224-4e69-8b11-9925a1c0a06b" status: 200 len: 194 microversion: 2.20 time: 0.051438 Feb 16 05:38:15.773059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 371/729] 10.222.0.75 () {60 vars in 1453 bytes} [Wed Feb 16 05:38:15 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments/7b0330ca-3224-4e69-8b11-9925a1c0a06b => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:38:15.832168 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:15.832668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:15.838462 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.838919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.839727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:15.840344 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:15.918528 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lazy-loading 'services' on Instance uuid 03664210-52cd-4649-abb9-282e98802be3 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:38:15.990482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-37cf0ef9-2816-490d-9428-bedd8069471f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments/7b0330ca-3224-4e69-8b11-9925a1c0a06b" status: 202 len: 0 microversion: 2.20 time: 0.161932 Feb 16 05:38:15.991621 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 359/730] 10.222.0.75 () {60 vars in 1456 bytes} [Wed Feb 16 05:38:15 2022] DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments/7b0330ca-3224-4e69-8b11-9925a1c0a06b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:38:16.000216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:16.001396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:16.007671 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:16.008204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:16.009111 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:16.009721 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:16.050822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a2a2314c-91b3-47a1-b49d-ceaf7332f1d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054855 Feb 16 05:38:16.051276 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 372/731] 10.222.0.75 () {60 vars in 1342 bytes} [Wed Feb 16 05:38:15 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:38:16.767386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:16.768083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:16.774681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:16.775137 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:16.775920 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:16.776358 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:16.930396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:16.942182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1d0513bf-66b9-4827-a73a-d867c69394c0 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1672 microversion: 2.1 time: 0.178825 Feb 16 05:38:16.942796 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 360/732] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:16 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:17.063047 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:17.064130 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:17.070593 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.071132 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.072214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.072653 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.101159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-14bad470-72ac-4ed8-9bb2-482109444d51 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042717 Feb 16 05:38:17.101760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 373/733] 10.222.0.75 () {60 vars in 1342 bytes} [Wed Feb 16 05:38:17 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:17.160338 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:17.160839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:17.166610 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.167321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.168103 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.168541 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.193530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:38:17.271030 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-24afdc78-c947-423a-be43-63a309577132 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 204 len: 0 microversion: 2.20 time: 0.114107 Feb 16 05:38:17.271885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 361/734] 10.222.0.75 () {60 vars in 1279 bytes} [Wed Feb 16 05:38:17 2022] DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:38:17.281867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:17.282833 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:17.289069 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.289556 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.290347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.290788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.628911 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:17.636795 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:17.639052 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:17.640266 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2a427f19-ac1a-48e0-9132-faf349e59a94 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.363898 Feb 16 05:38:17.640882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 374/735] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:17 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:38:17.960228 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:17.960922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:17.967429 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.967883 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:17.968678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:17.969113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:18.183443 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:18.192012 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-82da4ac6-7532-401b-985f-40edeae62743 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1672 microversion: 2.1 time: 0.235815 Feb 16 05:38:18.192931 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 362/736] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:17 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:18.659761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:18.661249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:18.673593 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:18.674396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:18.676232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:18.676616 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:18.836797 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:18.846726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:18.848296 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:18.850081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3786c40e-8cf3-455e-906f-ffbeb77d208f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.193856 Feb 16 05:38:18.850719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 375/737] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:18 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:19.120708 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-0ea96cbb-cb9a-43b0-ad95-d747a6fd8c88 req-96bf1875-fcb4-45a2-8887-3f1b66b12c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7bbecd5-0b2b-42ad-905e-cff757d16934", "name": "network-vif-deleted", "tag": "ea0bb21c-e630-4bb0-9c90-163cf454c5fa"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:19.125113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:19.125113 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:38:19.132859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0ea96cbb-cb9a-43b0-ad95-d747a6fd8c88 req-96bf1875-fcb4-45a2-8887-3f1b66b12c39 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:19.133540 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0ea96cbb-cb9a-43b0-ad95-d747a6fd8c88 req-96bf1875-fcb4-45a2-8887-3f1b66b12c39 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:19.148475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-0ea96cbb-cb9a-43b0-ad95-d747a6fd8c88 req-96bf1875-fcb4-45a2-8887-3f1b66b12c39 service nova] Creating event network-vif-deleted:ea0bb21c-e630-4bb0-9c90-163cf454c5fa for instance e7bbecd5-0b2b-42ad-905e-cff757d16934 on hv-cinder-82947 Feb 16 05:38:19.167743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-0ea96cbb-cb9a-43b0-ad95-d747a6fd8c88 req-96bf1875-fcb4-45a2-8887-3f1b66b12c39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051042 Feb 16 05:38:19.173522 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 363/738] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:19.210580 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:19.211191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:19.224429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:19.225471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:19.226532 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:19.228078 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:19.372055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:19.383872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-947a2d8a-69a4-4e6d-9324-d502a78f3d00 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 200 len: 1323 microversion: 2.1 time: 0.176954 Feb 16 05:38:19.384962 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 376/739] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:19 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 1323 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:19.868966 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:19.869638 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:19.878101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:19.883700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:19.884835 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:19.885293 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:20.282775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:20.295003 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:20.296996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:20.298373 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-68046590-e590-43cb-87bf-67a974c24499 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1722 microversion: 2.20 time: 0.433872 Feb 16 05:38:20.298967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 364/740] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:19 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:20.407285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:20.407992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:20.421305 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:20.421822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:20.425764 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:20.426731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:20.452588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. Feb 16 05:38:20.453900 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:38:20.455184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bc087b72-6075-409c-90e3-bfc9c1cfb231 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 404 len: 111 microversion: 2.1 time: 0.053018 Feb 16 05:38:20.456137 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 377/741] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:20 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:38:20.467286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d76a6db2-5de8-4485-b889-ee38ff78380b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '.version_select at 0x7fc5915524c0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:20.509174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d76a6db2-5de8-4485-b889-ee38ff78380b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257591515" status: 202 len: 0 microversion: 2.1 time: 0.047385 Feb 16 05:38:20.514197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 365/742] 10.222.0.75 () {58 vars in 1220 bytes} [Wed Feb 16 05:38:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257591515 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:38:21.212443 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-3e45527a-d401-49d6-bfe9-1987f72cf103 req-d31e8765-ff76-4946-bc98-001a0b0e84be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03664210-52cd-4649-abb9-282e98802be3", "name": "network-vif-deleted", "tag": "1b21e5ec-67af-4154-90a7-d10f66f9f96b"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:21.215486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:21.215486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:38:21.252697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-3e45527a-d401-49d6-bfe9-1987f72cf103 req-d31e8765-ff76-4946-bc98-001a0b0e84be service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:21.253507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-3e45527a-d401-49d6-bfe9-1987f72cf103 req-d31e8765-ff76-4946-bc98-001a0b0e84be service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:21.278307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-3e45527a-d401-49d6-bfe9-1987f72cf103 req-d31e8765-ff76-4946-bc98-001a0b0e84be service nova] Creating event network-vif-deleted:1b21e5ec-67af-4154-90a7-d10f66f9f96b for instance 03664210-52cd-4649-abb9-282e98802be3 on hv-cinder-82947 Feb 16 05:38:21.288473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-3e45527a-d401-49d6-bfe9-1987f72cf103 req-d31e8765-ff76-4946-bc98-001a0b0e84be service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080827 Feb 16 05:38:21.289981 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 378/743] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:21.321568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:21.322254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:21.340422 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:21.340861 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:21.350732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:21.351181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:21.428167 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:21.428888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:21.429386 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lazy-loading 'fault' on Instance uuid 03664210-52cd-4649-abb9-282e98802be3 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:38:21.494907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:21.509169 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:21.512730 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:21.515906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7f2f229e-6f9e-4844-bab0-1403981b83e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 200 len: 1371 microversion: 2.20 time: 0.202462 Feb 16 05:38:21.517862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 366/744] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:21 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:21.747964 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: .version_select at 0x7fc591dd0670>, body: {"keypair": {"name": "tempest-keypair-2058012294"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:21.770750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:21.775448 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:22.066355 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:22.071546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'key_pairs'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:22.087990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1e956f8c-cd40-4742-9a57-65fc2e2dcdc1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.347975 Feb 16 05:38:22.088919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 379/745] 10.222.0.75 () {60 vars in 1157 bytes} [Wed Feb 16 05:38:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:22.539428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:22.540662 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:22.552582 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:22.553300 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:22.555684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:22.556290 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:22.582906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. Feb 16 05:38:22.583744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:38:22.584700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-811a8f5e-2ae2-4a24-9864-f15fad38c13c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 404 len: 111 microversion: 2.20 time: 0.048996 Feb 16 05:38:22.585596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 367/746] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:22 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:38:22.594536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6c1c32db-5782-4216-bcc0-2235e6996e3b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '.version_select at 0x7fc591e64670>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:22.634417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6c1c32db-5782-4216-bcc0-2235e6996e3b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983773172" status: 204 len: 0 microversion: 2.20 time: 0.044033 Feb 16 05:38:22.635601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 380/747] 10.222.0.75 () {60 vars in 1258 bytes} [Wed Feb 16 05:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983773172 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:38:23.930399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: .version_select at 0x7fc591552af0>, body: {"keypair": {"name": "tempest-keypair-1280203672"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:23.948628 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:23.954020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:24.300912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:24.305740 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:24.324249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-78977f2e-0d2a-439f-b322-be558fc77e91 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.397899 Feb 16 05:38:24.326639 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 368/748] 10.222.0.75 () {62 vars in 1198 bytes} [Wed Feb 16 05:38:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 401 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:38:25.057016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1800817348", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2eb181d3-f5c9-4c81-83e2-25a8e00b4c5c"}], "security_groups": [{"name": "tempest-securitygroup--665712087"}], "key_name": "tempest-keypair-2058012294", "user_data": "}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:25.203087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] validate_networks() for [('2eb181d3-f5c9-4c81-83e2-25a8e00b4c5c', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:38:26.368871 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:38:26.369475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:38:26.369769 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:38:26.370108 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:38:26.370516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:38:26.387987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:26.387987 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:26.388821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:26.389285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:26.414510 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:26.425209 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Getting quotas for user 737d115302cb48bb90f8c4771d6ad7f1 and project 59d95f84bb5c4548a82ead0d4d2cb38c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:26.440644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:38:26.452314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:38:26.470827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-614917333", "imageRef": "11d66b75-af09-43c2-a412-6093a1bf3e94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bff5ceb-655f-4b77-9e4f-6947f831595a"}], "security_groups": [{"name": "tempest-securitygroup--757083232"}], "key_name": "tempest-keypair-1280203672", "user_data": "}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:26.524321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-57e73883-0c07-48b1-99f4-2ec22245a979 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.472266 Feb 16 05:38:26.525461 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 381/749] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:38:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:38:26.538108 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-14ad8421-4099-4ef3-802a-ab67841e3e1a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:26.543252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-14ad8421-4099-4ef3-802a-ab67841e3e1a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:26.646781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] validate_networks() for [('8bff5ceb-655f-4b77-9e4f-6947f831595a', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:38:26.682389 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-14ad8421-4099-4ef3-802a-ab67841e3e1a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:26.690329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-14ad8421-4099-4ef3-802a-ab67841e3e1a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1238 microversion: 2.1 time: 0.158262 Feb 16 05:38:26.691105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 382/750] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:26 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1238 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:27.147392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:38:27.147900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:38:27.148380 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:38:27.149019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:38:27.149611 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:38:27.158909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:27.159399 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:27.160289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:27.160903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:27.178108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for project 98f0673600914ab1a0a8636e309c3306. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:27.182357 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Getting quotas for user 9d3207da0fb24b3f8f329b6837fd9376 and project 98f0673600914ab1a0a8636e309c3306. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:27.195769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:38:27.197973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='11d66b75-af09-43c2-a412-6093a1bf3e94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:38:27.251576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-305b005e-8a97-4aa4-8786-3db20e032eb4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.929944 Feb 16 05:38:27.252249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 369/751] 10.222.0.75 () {62 vars in 1187 bytes} [Wed Feb 16 05:38:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 16 05:38:27.261937 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:27.262547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:27.329240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:27.336677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:27.338237 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:27.340252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2ea1d446-310b-42e1-ae60-3790e0d5eb1d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1281 microversion: 2.20 time: 0.082083 Feb 16 05:38:27.340820 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 383/752] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:27 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:27.709618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:27.711086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:27.745699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:27.746317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:27.747288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:27.748198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:27.916038 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:27.942511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-53899db5-45d5-4491-9afd-b4d353185c74 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1298 microversion: 2.1 time: 0.238159 Feb 16 05:38:27.944311 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 370/753] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:27 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1298 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:28.358628 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:28.360007 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:28.370062 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:28.370521 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:28.371323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:28.371758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:28.549331 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:28.566175 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:28.574464 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:28.577533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-801bf8b1-b47d-43f6-a5f7-899933ddfbc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1333 microversion: 2.20 time: 0.224031 Feb 16 05:38:28.580575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 384/754] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:28 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1333 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:28.964593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:28.966830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:28.974001 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:28.974698 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:28.975684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:28.976284 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:29.295225 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:29.304939 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a6abdf3d-757d-492d-aba9-60cc1752b4ca tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.348714 Feb 16 05:38:29.312038 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 371/755] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:28 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:29.596869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:29.598220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:29.611776 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:29.613649 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:29.616396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:29.618503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:29.819195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:29.832895 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:29.838981 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:29.845465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dff295e1-7021-458f-b8aa-71442ccef847 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1339 microversion: 2.20 time: 0.252699 Feb 16 05:38:29.857735 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 385/756] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:29 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:30.329625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:30.330260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:30.342725 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:30.343170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:30.343979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:30.346856 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:30.484509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-92f24df6-352d-4318-9d65-f5ce67a88ac0 req-558f2184-2d51-457d-bdf2-60cca4bcda12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16170a04-6a12-4e3d-b6f0-b8d4ccf463be", "tag": "e23a7d90-c9d0-41fa-8147-86dc735e1a4c"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:30.490058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:30.490058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:38:30.543698 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-92f24df6-352d-4318-9d65-f5ce67a88ac0 req-558f2184-2d51-457d-bdf2-60cca4bcda12 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:30.544664 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-92f24df6-352d-4318-9d65-f5ce67a88ac0 req-558f2184-2d51-457d-bdf2-60cca4bcda12 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:30.566539 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-92f24df6-352d-4318-9d65-f5ce67a88ac0 req-558f2184-2d51-457d-bdf2-60cca4bcda12 service nova] Creating event network-changed:e23a7d90-c9d0-41fa-8147-86dc735e1a4c for instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be on hv-cinder-82947 Feb 16 05:38:30.588546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-92f24df6-352d-4318-9d65-f5ce67a88ac0 req-558f2184-2d51-457d-bdf2-60cca4bcda12 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115354 Feb 16 05:38:30.590286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 386/757] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:30.636780 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:30.647158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ded99535-8baa-4da6-aaf0-0d53e1103cf7 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.322845 Feb 16 05:38:30.659327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 372/758] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:30 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:30.866045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:30.866717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:30.882926 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:30.883388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:30.884215 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:30.884654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:31.516829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:31.529981 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:31.535056 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:31.536233 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-67e34058-589b-4c39-abb8-f9c60fdbc33a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.674438 Feb 16 05:38:31.536808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 387/759] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:30 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:31.679019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:31.680903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:31.693820 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:31.696349 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:31.701478 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:31.702128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:32.020868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:32.038474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c12c5cb3-9afe-441b-b938-34c7a84906bc tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.370925 Feb 16 05:38:32.040163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 373/760] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:31 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:32.554431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:32.555494 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:32.563004 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:32.563592 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:32.564525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:32.565291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:32.922558 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-ed507081-eb6f-4a67-ac80-3007304abe26 req-80bedd79-94b5-4f66-8bcf-aceb9ef7e212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:32.924315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:32.924315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:38:32.932648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-ed507081-eb6f-4a67-ac80-3007304abe26 req-80bedd79-94b5-4f66-8bcf-aceb9ef7e212 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:32.933495 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-ed507081-eb6f-4a67-ac80-3007304abe26 req-80bedd79-94b5-4f66-8bcf-aceb9ef7e212 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:32.946596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-ed507081-eb6f-4a67-ac80-3007304abe26 req-80bedd79-94b5-4f66-8bcf-aceb9ef7e212 service nova] Creating event network-changed:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:38:32.952428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-ed507081-eb6f-4a67-ac80-3007304abe26 req-80bedd79-94b5-4f66-8bcf-aceb9ef7e212 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213828 Feb 16 05:38:32.953718 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 374/761] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:33.056975 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:33.057715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:33.065970 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:33.066340 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:33.067186 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:33.067625 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:33.218588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:33.219545 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:33.226885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5e6a388b-b63e-45de-9df9-0797f036b732 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.173941 Feb 16 05:38:33.229475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 375/762] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:33 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:33.233248 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:33.237731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:33.245980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f589b1a8-04b3-4a52-89a0-540b67adb1e2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.692876 Feb 16 05:38:33.246876 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 388/763] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:32 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:34.245911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:34.246523 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:34.254326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:34.255038 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:34.255978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:34.256566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:34.267173 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:34.269924 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:34.288116 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:34.288724 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:34.289659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:34.290223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:34.410282 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:34.419394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b16c9abf-58cb-4fb5-840d-7534a995ff87 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.176640 Feb 16 05:38:34.420203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 376/764] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:34 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:34.676350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:34.685438 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:34.686961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:34.688373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b19d1939-a702-4222-93de-3ce32de71828 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.427624 Feb 16 05:38:34.689157 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 389/765] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:34 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:35.435823 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:35.436730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:35.442666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Action: 'create', calling method: .version_select at 0x7fc5914def70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1385593991"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:35.443655 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:35.444105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:35.444887 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:35.445350 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:35.462980 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for project 7e5222e96e134b27b8a588f1309a0097. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:35.468090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for user 87279464d1b74c0d88c95f4dec9871ae and project 7e5222e96e134b27b8a588f1309a0097. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:35.610482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:35.618847 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for project 7e5222e96e134b27b8a588f1309a0097. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:35.621777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8276ed8d-df5b-4de0-876b-a064bed8564a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.189486 Feb 16 05:38:35.623590 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for user 87279464d1b74c0d88c95f4dec9871ae and project 7e5222e96e134b27b8a588f1309a0097. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:35.628782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 390/766] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:35 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:35.637302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-797ea0da-5b84-43a1-8968-093969838a3e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.296613 Feb 16 05:38:35.638109 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 377/767] 10.222.0.75 () {60 vars in 1157 bytes} [Wed Feb 16 05:38:35 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:35.707220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:35.708082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:35.719107 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:35.719562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:35.720429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:35.720864 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:35.937406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:35.946303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:35.948089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:35.949407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0d8daa5f-aa5b-45ad-8366-ec6c8698921d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.246174 Feb 16 05:38:35.950676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 391/768] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:35 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:36.639503 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:36.641810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:36.651961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:36.652867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:36.655988 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:36.657021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:36.905611 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:36.913673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-dd53c822-a5ec-4d8b-8ea7-a73e3ec185c5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.279048 Feb 16 05:38:36.925598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 378/769] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:36 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:36.968777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:36.970493 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:36.983188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:36.983855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:36.985489 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:36.986539 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:37.217196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:37.228444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:37.231782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:37.233068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4d27c5e0-8489-4b56-a25a-3b7f444b30d6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.269493 Feb 16 05:38:37.233785 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 392/770] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:36 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:37.398552 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-b4f1fd2d-20e2-4286-90ca-f3b13b5e6ab2 req-f70fd319-e70b-4bff-ad26-bd386567c7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16170a04-6a12-4e3d-b6f0-b8d4ccf463be", "name": "network-vif-plugged", "status": "completed", "tag": "e23a7d90-c9d0-41fa-8147-86dc735e1a4c"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:37.401709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:37.401709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:38:37.409649 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b4f1fd2d-20e2-4286-90ca-f3b13b5e6ab2 req-f70fd319-e70b-4bff-ad26-bd386567c7fe service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:37.410102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b4f1fd2d-20e2-4286-90ca-f3b13b5e6ab2 req-f70fd319-e70b-4bff-ad26-bd386567c7fe service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:37.424799 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-b4f1fd2d-20e2-4286-90ca-f3b13b5e6ab2 req-f70fd319-e70b-4bff-ad26-bd386567c7fe service nova] Creating event network-vif-plugged:e23a7d90-c9d0-41fa-8147-86dc735e1a4c for instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be on hv-cinder-82947 Feb 16 05:38:37.433167 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-b4f1fd2d-20e2-4286-90ca-f3b13b5e6ab2 req-f70fd319-e70b-4bff-ad26-bd386567c7fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042742 Feb 16 05:38:37.436101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 379/771] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:37.931439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:37.932374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:37.939368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:37.939921 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:37.940793 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:37.941487 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:38.123925 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:38.135375 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7a6020dc-3a62-4e81-956b-54e67c5ac06d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1363 microversion: 2.1 time: 0.207968 Feb 16 05:38:38.136365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 393/772] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:37 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:38.252285 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:38.252984 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:38.259496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:38.259880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:38.260673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:38.261110 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:38.398348 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:38.406870 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:38.408806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:38.410037 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b50c652d-b04c-46da-b099-cbe0d3cefced tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.162288 Feb 16 05:38:38.410604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 380/773] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:38 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:39.152928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:39.154268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:39.160484 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.160846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.161702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.162141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.304989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:39.313342 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-326906bb-e3c9-4dbc-8b37-0a1ef505f2b4 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1549 microversion: 2.1 time: 0.164099 Feb 16 05:38:39.313920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 394/774] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:39 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:39.330443 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:39.330952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:39.337235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.337715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.338488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.338923 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.422494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d7107fb6-7250-4449-824e-5886a7f037cf tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095868 Feb 16 05:38:39.423091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 381/775] 10.222.0.75 () {58 vars in 1274 bytes} [Wed Feb 16 05:38:39 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:39.428193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:39.428805 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:39.435190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.435644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.436430 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.436861 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.533872 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-0d018d71-f44f-4fe5-bde7-8b7e15bfa8c6 req-9efcbd49-253a-4eb1-9d03-eb1d6288a046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "name": "network-vif-plugged", "status": "completed", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:39.535556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:39.535556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:38:39.543040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0d018d71-f44f-4fe5-bde7-8b7e15bfa8c6 req-9efcbd49-253a-4eb1-9d03-eb1d6288a046 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:39.543480 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0d018d71-f44f-4fe5-bde7-8b7e15bfa8c6 req-9efcbd49-253a-4eb1-9d03-eb1d6288a046 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:39.559060 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-0d018d71-f44f-4fe5-bde7-8b7e15bfa8c6 req-9efcbd49-253a-4eb1-9d03-eb1d6288a046 service nova] Creating event network-vif-plugged:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:38:39.564581 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-0d018d71-f44f-4fe5-bde7-8b7e15bfa8c6 req-9efcbd49-253a-4eb1-9d03-eb1d6288a046 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113356 Feb 16 05:38:39.565190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 382/776] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:39.596542 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:39.606701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:39.609041 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:39.610626 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9b1ce18f-122d-4d9a-887e-f49085be46b2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.186064 Feb 16 05:38:39.611194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 395/777] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:39 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:38:40.398750 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:40.400553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:40.410110 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:40.410656 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:40.411517 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:40.411964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:40.438341 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ffc5d60e-7577-45d1-a03b-0a1d0453bb3c tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/ips" status: 200 len: 106 microversion: 2.1 time: 0.046950 Feb 16 05:38:40.438928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 383/778] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:38:40 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/ips => generated 106 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:40.466418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-a8aab2f4-4fa3-4012-9330-9b5f21f8925e req-64531917-e2e2-46fe-9f1d-ed30b1580da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16170a04-6a12-4e3d-b6f0-b8d4ccf463be", "tag": "e23a7d90-c9d0-41fa-8147-86dc735e1a4c"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:40.467999 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:40.467999 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:38:40.475274 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-a8aab2f4-4fa3-4012-9330-9b5f21f8925e req-64531917-e2e2-46fe-9f1d-ed30b1580da4 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:40.475712 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-a8aab2f4-4fa3-4012-9330-9b5f21f8925e req-64531917-e2e2-46fe-9f1d-ed30b1580da4 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:40.487088 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-a8aab2f4-4fa3-4012-9330-9b5f21f8925e req-64531917-e2e2-46fe-9f1d-ed30b1580da4 service nova] Creating event network-changed:e23a7d90-c9d0-41fa-8147-86dc735e1a4c for instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be on hv-cinder-82947 Feb 16 05:38:40.492347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-a8aab2f4-4fa3-4012-9330-9b5f21f8925e req-64531917-e2e2-46fe-9f1d-ed30b1580da4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098660 Feb 16 05:38:40.493122 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 396/779] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:38:40.628886 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:40.629548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:40.639899 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:40.640357 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:40.641155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:40.641807 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:40.853990 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:40.863706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:40.865598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:40.866810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ce133926-a0fd-4885-ab81-3ad63abbe144 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1406 microversion: 2.20 time: 0.241928 Feb 16 05:38:40.867446 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 384/780] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:40 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:38:41.828034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "291f726e-1315-485d-b198-ee69a66a8e29"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:41.829158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:41.835243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:41.835696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:41.836495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:41.836929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:41.883600 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:41.884986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:41.891436 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:41.891878 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:41.892642 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:41.893067 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:42.035380 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:42.044902 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:42.046431 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:42.047583 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b2fc83cf-9a2e-4a3e-913d-04de7aee9468 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1598 microversion: 2.20 time: 0.167697 Feb 16 05:38:42.048151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 385/781] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:38:41 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:38:42.064976 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:42.065510 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:42.071381 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:42.071867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:42.072907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:42.073379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:42.098258 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f212eecf-b826-41d6-9670-42073753817a tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274581 Feb 16 05:38:42.098955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 397/782] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:38:41 2022] POST /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:42.172606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f68191d4-9967-4681-8f73-af145ae3b71f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111212 Feb 16 05:38:42.173220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 386/783] 10.222.0.75 () {60 vars in 1315 bytes} [Wed Feb 16 05:38:42 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 05:38:43.318725 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:43.319301 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:43.320675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-d997923a-8662-483a-8653-e0657cf911ca req-35e444b1-ed00-461d-b5fb-defead7512dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:43.322281 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:43.322281 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:38:43.326340 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:43.327193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:43.328141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:43.328736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:43.329692 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-d997923a-8662-483a-8653-e0657cf911ca req-35e444b1-ed00-461d-b5fb-defead7512dc service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:43.330141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-d997923a-8662-483a-8653-e0657cf911ca req-35e444b1-ed00-461d-b5fb-defead7512dc service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:43.343580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-d997923a-8662-483a-8653-e0657cf911ca req-35e444b1-ed00-461d-b5fb-defead7512dc service nova] Creating event network-changed:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:38:43.348821 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-d997923a-8662-483a-8653-e0657cf911ca req-35e444b1-ed00-461d-b5fb-defead7512dc service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Feb 16 05:38:43.349580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 387/784] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:38:43.354927 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-17fa38ca-411c-4455-9d07-6fe359420a46 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/ips" status: 200 len: 112 microversion: 2.20 time: 0.040420 Feb 16 05:38:43.355608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 398/785] 10.222.0.75 () {60 vars in 1288 bytes} [Wed Feb 16 05:38:43 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/ips => generated 112 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:38:49.563057 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:49.564063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:49.571169 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:49.571615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:49.572403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:49.572840 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:49.601926 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5391df90-f2d4-4e2e-910d-626b8335f295 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Feb 16 05:38:49.602486 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 388/786] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:38:49 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:49.612154 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:49.612633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:49.618915 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:49.619359 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:49.620124 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:49.620555 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:49.648650 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4b5eb667-e0e5-49a6-9160-d98ffe15322d tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29" status: 200 len: 194 microversion: 2.1 time: 0.040274 Feb 16 05:38:49.649220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 399/787] 10.222.0.75 () {58 vars in 1412 bytes} [Wed Feb 16 05:38:49 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:50.944374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "295f3d3b-b478-49a8-b0e0-f444416eb956"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:50.945451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:50.952200 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:50.952639 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:50.953432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:50.953865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:51.224705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-535f5f49-9c5f-4cb7-a8a2-e5ed3ae46e1b tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "POST /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283859 Feb 16 05:38:51.225353 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 389/788] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:38:50 2022] POST /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:53.260495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2033675819", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385593991", "security_groups": [{"name": "tempest-secgroup-smoke-2011454409"}], "block_device_mapping_v2": [{"uuid": "a3871864-c627-4979-a33b-db02093eeca7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af5e8334-9cb2-4ddc-b153-43f6f162f135"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:53.369452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] validate_networks() for [('af5e8334-9cb2-4ddc-b153-43f6f162f135', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:38:53.727155 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:38:53.727584 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:38:53.728061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:38:53.728473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:38:53.728916 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:38:53.737979 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:53.738431 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:53.739242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:53.739685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:53.756030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:38:53.759905 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for user 87279464d1b74c0d88c95f4dec9871ae and project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:38:53.813687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:38:53.815822 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3871864-c627-4979-a33b-db02093eeca7',volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:38:53.936929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2378f889-20be-48da-8a19-f38253398883 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680088 Feb 16 05:38:53.937614 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 400/789] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:38:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:38:53.948384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b95511cd-683d-4f1e-b869-b7352e0b9f19 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:53.949201 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b95511cd-683d-4f1e-b869-b7352e0b9f19 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:54.002439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b95511cd-683d-4f1e-b869-b7352e0b9f19 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:54.008782 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b95511cd-683d-4f1e-b869-b7352e0b9f19 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1095 microversion: 2.1 time: 0.064984 Feb 16 05:38:54.009369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 390/790] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:53 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:55.027243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:55.028240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:55.035368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:55.035818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:55.036607 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:55.037040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:55.367040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:55.374239 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9a58a1ad-8b9c-4bfc-b34b-54ece8585238 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1211 microversion: 2.1 time: 0.351702 Feb 16 05:38:55.374805 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 401/791] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:55 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1211 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:56.391791 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:56.393405 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:56.400969 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:56.401771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:56.402793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:56.403475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:56.557612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:56.564940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c632a1a4-710b-44b6-a9df-95adef912726 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1279 microversion: 2.1 time: 0.177574 Feb 16 05:38:56.565601 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 391/792] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:56 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:56.617158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-4d9b77d6-fc5f-4c21-a404-4d7353a473f7 req-9e63039e-d348-4565-be15-c3ab7ce1624a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c79d1-09d2-4e14-b144-40a132b546d6", "tag": "f42f8d9e-47f2-47ff-a24a-282b5e026e62"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:38:56.621971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:38:56.621971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:38:56.633719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4d9b77d6-fc5f-4c21-a404-4d7353a473f7 req-9e63039e-d348-4565-be15-c3ab7ce1624a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:56.634158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-4d9b77d6-fc5f-4c21-a404-4d7353a473f7 req-9e63039e-d348-4565-be15-c3ab7ce1624a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:56.646404 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-4d9b77d6-fc5f-4c21-a404-4d7353a473f7 req-9e63039e-d348-4565-be15-c3ab7ce1624a service nova] Creating event network-changed:f42f8d9e-47f2-47ff-a24a-282b5e026e62 for instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 on hv-cinder-82947 Feb 16 05:38:56.653296 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-4d9b77d6-fc5f-4c21-a404-4d7353a473f7 req-9e63039e-d348-4565-be15-c3ab7ce1624a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051593 Feb 16 05:38:56.654338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 402/793] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:57.582211 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:57.583065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:57.589385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:57.589953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:57.590850 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:57.592192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:57.732080 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:57.739519 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-73887bde-4d79-4aa7-ae3b-c205b96c9d05 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1279 microversion: 2.1 time: 0.161137 Feb 16 05:38:57.740083 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 392/794] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:57 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:38:58.707010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:58.708000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:58.714003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:58.714422 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:58.715311 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:58.715875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:58.747935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-41b6d376-f8e2-49de-96c2-62d67eed15f5 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045470 Feb 16 05:38:58.748495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 403/795] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:38:58 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:38:58.755914 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:58.756419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:58.762704 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:58.763203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:58.764082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:58.764682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:58.915041 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:38:58.923221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4593d7bf-bbc3-447a-85e7-aac6154653e6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1279 microversion: 2.1 time: 0.171281 Feb 16 05:38:58.923800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 393/796] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:58 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:38:59.939687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:38:59.940299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:38:59.946567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:59.946994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:38:59.947762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:38:59.948195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:00.087299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:00.094569 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-37687d21-1c3b-4af6-abd9-7149b1bac98d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.158539 Feb 16 05:39:00.095142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 404/797] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:38:59 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:01.111622 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:01.112233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:01.118495 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:01.118947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:01.119775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:01.120155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:01.253171 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:01.260354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0234d231-33c6-48ea-a653-85d634c55127 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.152384 Feb 16 05:39:01.260924 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 394/798] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:01 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:02.277461 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:02.278068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:02.284842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:02.285313 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:02.286083 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:02.286514 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:02.420602 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:02.427730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a3c33e85-679f-449b-bd83-2c94780e2b3f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.153900 Feb 16 05:39:02.428296 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 405/799] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:02 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:03.444668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:03.445302 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:03.451571 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:03.452027 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:03.452809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:03.453247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:03.584914 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:03.592693 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-72d202ef-c16a-4f13-99c9-33aaae0e970e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.151682 Feb 16 05:39:03.593275 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 395/800] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:03 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:04.609235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:04.609872 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:04.616257 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:04.616709 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:04.617516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:04.617956 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:04.754159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:04.761713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5a35cf99-2b4b-41ec-9197-1c2d946098ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.156100 Feb 16 05:39:04.762285 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 406/801] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:04 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:05.777875 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:05.778398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:05.785197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:05.785682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:05.786463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:05.786897 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:05.921741 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:05.929049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c03ae0b1-c0c0-4058-8335-e2f6e7e962ee tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.154865 Feb 16 05:39:05.929664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 396/802] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:05 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:06.945700 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:06.946217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:06.953118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:06.953599 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:06.954385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:06.954827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:07.086133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:07.093974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5d0f4e89-73a4-496f-9b85-5ccbec57fee1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.151962 Feb 16 05:39:07.094570 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 407/803] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:06 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:08.112415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:08.113040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:08.119359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:08.119810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:08.120589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:08.121027 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:08.259259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:08.266551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cd09e0f8-1800-4b51-8549-3957aceb4ce0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.159142 Feb 16 05:39:08.267126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 397/804] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:08 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:09.256781 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-7122d110-8570-4797-a63c-a68580d713ea req-a7cb7562-42b5-4635-8f99-009be6aeb3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c79d1-09d2-4e14-b144-40a132b546d6", "name": "network-vif-plugged", "status": "completed", "tag": "f42f8d9e-47f2-47ff-a24a-282b5e026e62"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:09.258368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:39:09.258368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:39:09.265986 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-7122d110-8570-4797-a63c-a68580d713ea req-a7cb7562-42b5-4635-8f99-009be6aeb3bb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:09.266436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-7122d110-8570-4797-a63c-a68580d713ea req-a7cb7562-42b5-4635-8f99-009be6aeb3bb service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:09.277184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-7122d110-8570-4797-a63c-a68580d713ea req-a7cb7562-42b5-4635-8f99-009be6aeb3bb service nova] Creating event network-vif-plugged:f42f8d9e-47f2-47ff-a24a-282b5e026e62 for instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 on hv-cinder-82947 Feb 16 05:39:09.282572 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-7122d110-8570-4797-a63c-a68580d713ea req-a7cb7562-42b5-4635-8f99-009be6aeb3bb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029410 Feb 16 05:39:09.283428 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 408/805] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:39:09.284553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:09.285244 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:09.292379 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:09.292958 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:09.293834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:09.294345 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:09.434774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:09.442600 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-40bf4d57-fe93-4317-bae6-19101c2d68db tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.163428 Feb 16 05:39:09.443173 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 398/806] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:09 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:39:10.460308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:10.461019 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:10.467118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:10.467675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:10.468317 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:10.468855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:10.615739 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:10.623534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-031b3f6e-5659-4a39-8a24-854054f01e71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1267 microversion: 2.1 time: 0.167638 Feb 16 05:39:10.624107 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 409/807] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:10 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:11.640502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:11.641117 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:11.647384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:11.647831 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:11.648607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:11.649045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:11.784233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:11.791694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-494ecacb-d87c-4150-b477-41bf55d7327c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1453 microversion: 2.1 time: 0.155428 Feb 16 05:39:11.792257 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 399/808] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:11 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:11.807867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:11.808486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:11.815395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:11.815848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:11.816630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:11.817072 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:11.948798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:11.956633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-95eba097-6707-4bd9-84be-125cadaa927b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1453 microversion: 2.1 time: 0.152372 Feb 16 05:39:11.957207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 410/809] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:11 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:13.588588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-0d8bb9f0-7556-463e-aae9-1473933a3943 req-4cfd359b-ff2e-4814-b359-22988d2e2d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5c79d1-09d2-4e14-b144-40a132b546d6", "tag": "f42f8d9e-47f2-47ff-a24a-282b5e026e62"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:13.590876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:39:13.590876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:39:13.599409 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0d8bb9f0-7556-463e-aae9-1473933a3943 req-4cfd359b-ff2e-4814-b359-22988d2e2d04 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:13.600414 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-0d8bb9f0-7556-463e-aae9-1473933a3943 req-4cfd359b-ff2e-4814-b359-22988d2e2d04 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:13.612880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-0d8bb9f0-7556-463e-aae9-1473933a3943 req-4cfd359b-ff2e-4814-b359-22988d2e2d04 service nova] Creating event network-changed:f42f8d9e-47f2-47ff-a24a-282b5e026e62 for instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 on hv-cinder-82947 Feb 16 05:39:13.618370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-0d8bb9f0-7556-463e-aae9-1473933a3943 req-4cfd359b-ff2e-4814-b359-22988d2e2d04 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Feb 16 05:39:13.619414 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 400/810] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:39:20.934245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:20.934758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:20.940923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:20.941422 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:20.942192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:20.942620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:20.964678 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lazy-loading 'flavor' on Instance uuid 5c112142-abdc-4305-9f88-55a64404a86d {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:39:21.043020 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:21.043668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:21.050385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.050836 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.051620 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.052126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.079723 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-51ce611c-eb98-4686-bee5-90f8076fdd54 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29" status: 200 len: 194 microversion: 2.1 time: 0.041628 Feb 16 05:39:21.080308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 401/811] 10.222.0.75 () {58 vars in 1412 bytes} [Wed Feb 16 05:39:21 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:39:21.089165 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:21.089678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:21.095524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.095981 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.096754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.097191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.173548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lazy-loading 'services' on Instance uuid 16170a04-6a12-4e3d-b6f0-b8d4ccf463be {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:39:21.217413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cd57375d-894c-48d9-99f8-7d051e8d640d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/action" status: 202 len: 0 microversion: 2.20 time: 0.286736 Feb 16 05:39:21.219471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 411/812] 10.222.0.75 () {62 vars in 1318 bytes} [Wed Feb 16 05:39:20 2022] POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:39:21.226303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:21.226973 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:21.233387 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.233851 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.234792 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:21.235238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:21.245420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c9334a5f-1e03-4c17-9cfb-b292209f1f60 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29" status: 202 len: 0 microversion: 2.1 time: 0.159199 Feb 16 05:39:21.246134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 402/813] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:39:21 2022] DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/291f726e-1315-485d-b198-ee69a66a8e29 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 05:39:21.382978 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:21.391550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:21.393373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:21.394656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eaa95928-df99-43f2-9a6f-e596ca8200e0 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.172434 Feb 16 05:39:21.395482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 412/814] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:21 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:39:22.412487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:22.413188 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:22.419516 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:22.419967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:22.420743 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:22.421181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:22.554785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:22.563254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:22.565299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:22.566652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2a683f72-e2e2-4695-ad1f-252b3a7b5d8c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.158609 Feb 16 05:39:22.567224 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 403/815] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:22 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:23.402826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:23.403309 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:23.409770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.410217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.411016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.411445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.439660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-732c0bb1-c098-4312-a613-6ea45ef1e194 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/295f3d3b-b478-49a8-b0e0-f444416eb956" status: 200 len: 194 microversion: 2.1 time: 0.040789 Feb 16 05:39:23.440229 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 413/816] 10.222.0.75 () {58 vars in 1412 bytes} [Wed Feb 16 05:39:23 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/295f3d3b-b478-49a8-b0e0-f444416eb956 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:39:23.449471 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:23.449940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:23.455671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.456114 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.456887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.457346 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.535838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lazy-loading 'services' on Instance uuid 16170a04-6a12-4e3d-b6f0-b8d4ccf463be {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:39:23.584439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:23.585066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:23.591067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.592037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.592858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:23.593320 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:23.605748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0abe5405-67c5-4c7f-b1f8-2ace65864174 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/295f3d3b-b478-49a8-b0e0-f444416eb956" status: 202 len: 0 microversion: 2.1 time: 0.159892 Feb 16 05:39:23.606724 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 404/817] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:39:23 2022] DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments/295f3d3b-b478-49a8-b0e0-f444416eb956 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:39:23.739169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:23.746862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:23.748445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:23.749624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-42ea79e7-ed1b-48d4-b4bc-1c9bbfb8d6c4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.168844 Feb 16 05:39:23.750184 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 414/818] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:23 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:39:24.759288 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:24.760389 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:24.767058 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.767508 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.768006 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:24.768425 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.768622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:24.768748 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.774838 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.775293 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.776078 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.776521 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.796967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4ed32d2f-2614-4977-a5ea-a2ecbb98cf09 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042229 Feb 16 05:39:24.797564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 405/819] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:39:24 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 16 05:39:24.897773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:24.898765 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:24.904747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.905201 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.906073 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.906575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:24.910374 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:24.918385 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:24.919900 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:24.921053 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bf827346-62e3-45c8-b02e-f9dc85febeeb tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.156733 Feb 16 05:39:24.921645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 415/820] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:24 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:39:24.937793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-59963c2c-f908-420b-86af-7a0772066810 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043611 Feb 16 05:39:24.938366 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 406/821] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:39:24 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 16 05:39:24.992485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:24.992983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:24.999320 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:24.999766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:25.000540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:25.000977 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:25.025595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:39:25.096141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e860c41e-89d0-4644-b6b3-790ee930a2f2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 204 len: 0 microversion: 2.1 time: 0.106880 Feb 16 05:39:25.096717 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 416/822] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:39:24 2022] DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:39:25.104678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:25.105346 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:25.111899 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:25.112352 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:25.113215 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:25.113686 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:25.244444 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:25.252126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d06583a8-5f7c-4e5c-8d4b-a092053b5ec8 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1673 microversion: 2.1 time: 0.151166 Feb 16 05:39:25.252688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 407/823] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:25 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:25.938648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:25.939269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:25.945562 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:25.946021 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:25.946800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:25.947235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:26.077879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:26.085488 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:26.086995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:26.088139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ba07d3a0-9447-4266-a9e5-f0c4392a1c69 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.153700 Feb 16 05:39:26.088701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 417/824] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:25 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:26.269719 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:26.270260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:26.276615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:26.277067 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:26.277871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:26.278304 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:26.412935 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:26.421157 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c9f92d92-07bb-463c-aa25-9527287d97e1 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1673 microversion: 2.1 time: 0.155560 Feb 16 05:39:26.421745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 408/825] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:26 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:27.106561 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:27.107744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:27.114167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:27.114622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:27.115394 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:27.115828 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:27.323801 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:27.331534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:27.333032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:27.334208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-39627999-79ee-46ea-aeb1-25a058150803 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.231381 Feb 16 05:39:27.334770 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 418/826] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:27 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:27.438013 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:27.438615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:27.444882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:27.445369 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:27.446149 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:27.446584 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:27.579722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:27.587394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-14b49455-4281-4b26-9ee5-654afb57ddc9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1673 microversion: 2.1 time: 0.152973 Feb 16 05:39:27.587990 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 409/827] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:27 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:28.337140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-82e38f22-4f63-4a9c-ac60-901c00ab5491 req-155a0f5d-f983-4e5a-999d-856dcaa78ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16170a04-6a12-4e3d-b6f0-b8d4ccf463be", "name": "network-vif-deleted", "tag": "e23a7d90-c9d0-41fa-8147-86dc735e1a4c"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:28.339147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:39:28.339147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:39:28.349190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-82e38f22-4f63-4a9c-ac60-901c00ab5491 req-155a0f5d-f983-4e5a-999d-856dcaa78ef0 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.349679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-82e38f22-4f63-4a9c-ac60-901c00ab5491 req-155a0f5d-f983-4e5a-999d-856dcaa78ef0 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.351900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:28.352580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:28.364184 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.364637 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.365491 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.365904 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.371585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-82e38f22-4f63-4a9c-ac60-901c00ab5491 req-155a0f5d-f983-4e5a-999d-856dcaa78ef0 service nova] Creating event network-vif-deleted:e23a7d90-c9d0-41fa-8147-86dc735e1a4c for instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be on hv-cinder-82947 Feb 16 05:39:28.384434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-82e38f22-4f63-4a9c-ac60-901c00ab5491 req-155a0f5d-f983-4e5a-999d-856dcaa78ef0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051487 Feb 16 05:39:28.385232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 419/828] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:39:28.551364 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:28.562739 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:28.564531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:28.565945 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1e6720e6-b250-43a8-a4e3-1f37ec45b6b4 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.217862 Feb 16 05:39:28.566715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 410/829] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:28 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:39:28.604788 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:28.605919 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:28.612918 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.613414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.614220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.615100 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.645685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:28.646141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:28.646588 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lazy-loading 'fault' on Instance uuid 16170a04-6a12-4e3d-b6f0-b8d4ccf463be {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:39:28.688628 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d115302cb48bb90f8c4771d6ad7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d95f84bb5c4548a82ead0d4d2cb38c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:28.695961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6be4a2a4-f3ba-463f-a8f7-222608e6ebfd tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 200 len: 1328 microversion: 2.1 time: 0.095586 Feb 16 05:39:28.696535 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 420/830] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:28 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:39:29.584214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:29.584893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:29.591127 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:29.591648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:29.592422 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:29.592859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:29.713050 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:29.713878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:29.721463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:29.722200 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:29.723257 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:29.723975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:29.729661 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:29.738134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:29.738758 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. Feb 16 05:39:29.739359 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:39:29.739860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:29.740182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-10168da8-f840-4357-aa79-d90053098c69 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 404 len: 111 microversion: 2.1 time: 0.031045 Feb 16 05:39:29.740734 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 421/831] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:29 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:39:29.741236 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-39ffdc30-7caf-46cc-97ec-d678c9e20fc1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.160858 Feb 16 05:39:29.741910 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 411/832] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:29 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:29.749246 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4697269d-c24e-4be5-816e-04b0e74379ab tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '.version_select at 0x7fc591dee310>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:29.765941 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4697269d-c24e-4be5-816e-04b0e74379ab tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058012294" status: 202 len: 0 microversion: 2.1 time: 0.020777 Feb 16 05:39:29.766495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 422/833] 10.222.0.75 () {58 vars in 1220 bytes} [Wed Feb 16 05:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058012294 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 05:39:30.759836 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:30.760452 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:30.767385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:30.767839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:30.768615 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:30.769053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:30.900673 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:30.908373 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:30.909916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:30.911068 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-fe5a7f0a-238f-47cf-835e-9f214b343bd9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.155001 Feb 16 05:39:30.911627 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 412/834] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:30 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:31.929493 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:31.930096 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:31.937182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:31.937656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:31.938430 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:31.938865 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:32.070475 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:32.078158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:32.079665 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:32.080807 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-652c8f82-a92a-4d68-8707-2cadf44ae056 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1744 microversion: 2.20 time: 0.155594 Feb 16 05:39:32.081383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 423/835] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:31 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:32.620606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:32.621131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:32.627351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:32.627794 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:32.628558 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:32.628988 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:32.642062 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. Feb 16 05:39:32.642629 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:39:32.643421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-89b71e43-45af-4fa4-8bb5-dae05e7d8ef9 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 404 len: 111 microversion: 2.1 time: 0.026414 Feb 16 05:39:32.643925 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 413/836] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:39:32 2022] DELETE /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:39:32.651365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:32.651994 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: 16170a04-6a12-4e3d-b6f0-b8d4ccf463be] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:32.658472 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:32.658925 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:32.659703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:32.660145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:32.673367 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. Feb 16 05:39:32.673965 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance 16170a04-6a12-4e3d-b6f0-b8d4ccf463be could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:39:32.674789 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-cd59ae33-39f4-41c5-91e8-c514d3771c06 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be" status: 404 len: 111 microversion: 2.1 time: 0.027103 Feb 16 05:39:32.675355 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 424/837] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:32 2022] GET /compute/v2.1/servers/16170a04-6a12-4e3d-b6f0-b8d4ccf463be => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:39:33.098071 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:33.098674 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:33.104496 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.104936 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.105735 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.106166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.238151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:33.245802 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:33.247308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:33.248983 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e4f3f2fd-1b01-477e-b1ff-2affa631702d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1744 microversion: 2.20 time: 0.154665 Feb 16 05:39:33.249803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 414/838] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:33 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:33.799839 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:33.800323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:33.806779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.807233 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.808942 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.809433 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.823111 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. Feb 16 05:39:33.823715 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:39:33.824539 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ed9f47a2-dc4c-49eb-a118-fc49149bd155 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 404 len: 111 microversion: 2.1 time: 0.028382 Feb 16 05:39:33.825630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 425/839] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:39:33 2022] DELETE /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:39:33.833546 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:33.834286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] [instance: e7bbecd5-0b2b-42ad-905e-cff757d16934] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:33.840785 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.841480 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.842270 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:33.842712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:33.859082 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] HTTP exception thrown: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. Feb 16 05:39:33.859675 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] Returning 404 to user: Instance e7bbecd5-0b2b-42ad-905e-cff757d16934 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:39:33.860527 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-21b253a2-ba2b-4818-a292-014b2a3105a2 tempest-AttachVolumeTestJSON-657382751 tempest-AttachVolumeTestJSON-657382751-project] 10.222.0.75 "GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934" status: 404 len: 111 microversion: 2.1 time: 0.030667 Feb 16 05:39:33.861071 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 415/840] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:39:33 2022] GET /compute/v2.1/servers/e7bbecd5-0b2b-42ad-905e-cff757d16934 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 05:39:34.266741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:34.267779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:34.274343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:34.274885 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:34.275736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:34.276242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:34.420217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:34.428361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:34.429884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:34.431061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e5a8c912-cc2c-4ba1-855c-9015c79a7c95 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.168086 Feb 16 05:39:34.431614 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 426/841] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:34 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:35.398834 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-51432d57-c631-476f-8ffd-23da4650b012 req-af6585f3-0814-4277-b136-85863907fc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "name": "network-vif-plugged", "status": "completed", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:35.400421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:39:35.400421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:39:35.413607 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-51432d57-c631-476f-8ffd-23da4650b012 req-af6585f3-0814-4277-b136-85863907fc4d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:35.414352 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-51432d57-c631-476f-8ffd-23da4650b012 req-af6585f3-0814-4277-b136-85863907fc4d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:35.429870 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-51432d57-c631-476f-8ffd-23da4650b012 req-af6585f3-0814-4277-b136-85863907fc4d service nova] Creating event network-vif-plugged:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:39:35.450679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:35.451880 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:35.458628 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-51432d57-c631-476f-8ffd-23da4650b012 req-af6585f3-0814-4277-b136-85863907fc4d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063302 Feb 16 05:39:35.459891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 416/842] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:39:35.465411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:35.466145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:35.467217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:35.467807 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:35.647944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:35.662493 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:35.665229 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:35.667321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-235cd3ee-0f71-4c57-b6fd-dce278489237 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.220650 Feb 16 05:39:35.668149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 427/843] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:35 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:39:36.687289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:36.687978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:36.694722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:36.694978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:36.695767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:36.696198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:37.002823 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:37.015197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:37.018321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:37.019767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4750b881-1661-494a-b031-a45d1d89db39 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.337301 Feb 16 05:39:37.020930 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 417/844] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:36 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:38.039151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:38.040701 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:38.047980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:38.048639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:38.049658 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:38.050288 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:38.363082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:38.373274 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:38.375447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:38.376877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-497f23a8-131d-47ee-9a88-3c7af4ecb9b5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.341399 Feb 16 05:39:38.388729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 428/845] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:38 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:39.395773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:39.396380 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:39.402954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:39.404572 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:39.405421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:39.408586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:39.569204 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:39.579271 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:39.581648 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:39.585057 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-651d47e6-68a5-4934-9c94-eda4e4f0f908 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.192943 Feb 16 05:39:39.586238 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 418/846] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:39 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:40.603907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:40.604525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:40.611761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:40.612221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:40.613023 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:40.613524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:40.754107 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:40.762242 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:40.764863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:40.766153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3a716424-bcf0-4839-9629-ec0d00a0bc5f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.165892 Feb 16 05:39:40.766644 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 429/847] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:40 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:41.784526 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:41.785942 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:41.792720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:41.793317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:41.794319 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:41.794888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:41.946600 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:41.955987 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:41.958303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:41.959477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-63f7c291-9133-4383-a528-ef631afc5324 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.178803 Feb 16 05:39:41.960059 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 419/848] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:41 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:42.979520 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:42.980937 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:42.992281 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:42.995522 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:42.996425 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:43.007411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:43.235549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:43.244440 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:43.246755 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:43.248262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-22873b31-f11b-4d4a-806e-97d963a32e81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.273127 Feb 16 05:39:43.259275 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 430/849] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:42 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:44.266865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:44.267517 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:44.273941 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:44.274388 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:44.275172 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:44.275605 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:44.406838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:44.418860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:44.420396 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:44.421686 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-bc17a6b4-0ac9-4469-8e06-ca826b6e8cf6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1739 microversion: 2.20 time: 0.159353 Feb 16 05:39:44.422246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 420/850] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:44 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:45.440117 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:45.440765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:45.446945 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:45.447402 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:45.448182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:45.448623 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:45.587906 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:45.595549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:45.597039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:45.598207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3ab8e14f-6d13-4443-abb9-c86be4494efc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1721 microversion: 2.20 time: 0.161811 Feb 16 05:39:45.598751 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 431/851] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:45 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:46.615609 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:46.616210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:46.622475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:46.622923 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:46.623689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:46.624121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:46.758975 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:46.766556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:46.768037 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:46.769168 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-090df504-714c-41fd-9ad9-c7b325b090b6 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1721 microversion: 2.20 time: 0.157244 Feb 16 05:39:46.769863 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 421/852] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:46 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:47.787474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:47.788082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:47.795114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:47.795566 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:47.796338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:47.796771 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:47.925767 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:47.933477 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:47.935602 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:47.936754 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-fa60f4be-7344-4a2e-9691-b4a04b3cd022 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1664 microversion: 2.20 time: 0.153051 Feb 16 05:39:47.937329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 432/853] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:47 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:47.953750 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e8a981-4902-44e3-91fd-c8e56a3112db"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:47.954801 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:47.961153 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:47.961647 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:47.962424 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:47.962864 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.217706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d09ca213-2bad-4aee-9d92-5e8926e88cc9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267640 Feb 16 05:39:48.218326 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 422/854] 10.222.0.75 () {62 vars in 1363 bytes} [Wed Feb 16 05:39:47 2022] POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments => generated 188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 05:39:48.324499 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:48.324989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:48.330738 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.331188 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.331961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.332402 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.587365 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-adf35c85-bb82-4999-9e12-cc329c5fcd9f tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments/78e8a981-4902-44e3-91fd-c8e56a3112db" status: 202 len: 0 microversion: 2.20 time: 0.266598 Feb 16 05:39:48.588118 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 433/855] 10.222.0.75 () {60 vars in 1456 bytes} [Wed Feb 16 05:39:48 2022] DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments/78e8a981-4902-44e3-91fd-c8e56a3112db => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:39:48.640310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:48.640879 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:48.647395 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.647853 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.648650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.649086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.724876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3821aad9-a059-4f45-8a3c-b13a59bd4120 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/action" status: 202 len: 0 microversion: 2.20 time: 0.088691 Feb 16 05:39:48.725619 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 423/856] 10.222.0.75 () {62 vars in 1318 bytes} [Wed Feb 16 05:39:48 2022] POST /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:39:48.734509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:48.735696 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:48.741076 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.741560 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.742343 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:48.742776 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:48.878432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:48.886882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:48.889004 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:48.890183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-805a970f-e467-450a-b4d6-545bb5713dc5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1672 microversion: 2.20 time: 0.160527 Feb 16 05:39:48.897323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 434/857] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:48 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:49.410033 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-5eadc541-78c8-4c3d-8fc2-489e0fbe0ce6 req-437d3771-d8d4-473a-8613-026231356110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "name": "network-vif-unplugged", "status": "completed", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:39:49.412134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:39:49.412134 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:39:49.420592 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-5eadc541-78c8-4c3d-8fc2-489e0fbe0ce6 req-437d3771-d8d4-473a-8613-026231356110 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:49.421477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-5eadc541-78c8-4c3d-8fc2-489e0fbe0ce6 req-437d3771-d8d4-473a-8613-026231356110 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:49.433289 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.compute.server_external_events [req-5eadc541-78c8-4c3d-8fc2-489e0fbe0ce6 req-437d3771-d8d4-473a-8613-026231356110 service nova] Unable to find a host for instance 5c112142-abdc-4305-9f88-55a64404a86d. Dropping event network-vif-unplugged {{(pid=122879) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 16 05:39:49.434293 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-5eadc541-78c8-4c3d-8fc2-489e0fbe0ce6 req-437d3771-d8d4-473a-8613-026231356110 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028567 Feb 16 05:39:49.435568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 424/858] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 16 05:39:49.909440 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:49.909854 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:49.916058 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:49.916516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:49.917357 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:49.917808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:50.059574 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:50.067803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:50.069417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:50.070591 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-71cf5000-3e47-494b-a128-cce1963ff4de tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.165463 Feb 16 05:39:50.071152 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 435/859] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:49 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:51.090245 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:51.090859 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:51.104324 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:51.105058 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:51.106088 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:51.106596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:51.252641 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:51.261359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:51.262975 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:51.264221 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8be8b836-0d34-4f70-bf4e-6345b08869fa tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.178525 Feb 16 05:39:51.264887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 425/860] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:51 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:52.281796 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:52.282409 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:52.288369 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:52.288824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:52.289645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:52.290388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:52.455193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:52.464858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:52.466617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:52.467990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-d0e32e6f-c508-4c91-b149-22fa5f928020 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.189958 Feb 16 05:39:52.468550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 436/861] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:52 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:53.487339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:53.488034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:53.494997 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:53.495420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:53.496214 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:53.496654 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:53.639604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:53.647842 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:53.649374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:53.650524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-18a36e54-ab05-40dd-bc66-574148a6af82 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.167609 Feb 16 05:39:53.651265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 426/862] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:53 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:54.671978 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:54.672600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:54.678990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:54.679450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:54.680240 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:54.680869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:54.827782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:54.836361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:54.838022 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:54.839261 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9ca5f8c6-187b-43af-8bdc-63de55c01a27 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.171143 Feb 16 05:39:54.844613 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 437/863] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:54 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:55.857793 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:55.859044 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:55.865876 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:55.866403 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:55.867264 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:55.867922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:56.041954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:56.050893 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:56.052376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:56.053569 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b88dff86-c2a0-4475-951e-5fe9d9c2705a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.200281 Feb 16 05:39:56.054465 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 427/864] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:55 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:57.072421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:57.073038 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:57.081464 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:57.082384 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:57.083399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:57.083845 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:57.259831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:57.282163 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:57.284370 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:57.286010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eeccd96b-adff-471c-9978-7e9f9f818e6e tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.217862 Feb 16 05:39:57.287342 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 438/865] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:57 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:58.305407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:58.306191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:58.314115 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:58.314812 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:58.315767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:58.316337 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:58.495407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:58.505712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:58.507672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:58.509395 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ec8be47a-d7b6-42f3-a5e7-b681a8a3ccd5 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.208274 Feb 16 05:39:58.514596 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 428/866] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:58 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:39:59.528957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:39:59.529713 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:39:59.536066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:59.536580 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:59.537480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:39:59.537998 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:39:59.674232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:59.682166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:59.683659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:39:59.685417 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-957038e9-0f02-4b0e-9ad6-8db4e880e0a2 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.159589 Feb 16 05:39:59.686174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 439/867] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:39:59 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:00.703745 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:00.704356 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:00.711043 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:00.711604 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:00.712397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:00.712961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:00.848724 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:00.856655 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:00.858196 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:00.859336 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-93de4177-46c4-4657-bb8f-a4120a75a621 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.159852 Feb 16 05:40:00.859885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 429/868] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:00 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:40:01.877331 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:01.877981 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:01.884170 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:01.884622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:01.885433 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:01.885873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:02.028165 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:02.036046 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:02.037655 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:02.038805 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-21d4268d-6461-439b-a419-1669780d5405 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.165151 Feb 16 05:40:02.039358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 440/869] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:01 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:03.057366 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:03.057973 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:03.064339 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:03.064786 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:03.065587 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:03.066017 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:03.209929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:03.218012 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:03.219509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:03.220652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-90db3912-3516-4bd3-81f6-e95a1db95059 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.166924 Feb 16 05:40:03.221210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 430/870] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:03 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:40:04.239133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:04.239910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:04.246434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:04.246884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:04.247664 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:04.248098 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:04.386040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:04.394601 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:04.396109 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:04.397338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f969d70d-97df-495a-ad21-70b7448e8502 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.162176 Feb 16 05:40:04.397897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 441/871] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:04 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:05.417314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:05.419259 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:05.429178 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:05.429658 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:05.431141 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:05.432923 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:05.525227 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-d5783e51-a6ec-4606-9cb7-0258aa62a6de req-e120a9da-4f91-48f0-9318-6fc4a0415032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "name": "network-vif-plugged", "status": "completed", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:40:05.527206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:40:05.527206 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:40:05.535703 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d5783e51-a6ec-4606-9cb7-0258aa62a6de req-e120a9da-4f91-48f0-9318-6fc4a0415032 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:05.536223 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d5783e51-a6ec-4606-9cb7-0258aa62a6de req-e120a9da-4f91-48f0-9318-6fc4a0415032 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:05.548401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-d5783e51-a6ec-4606-9cb7-0258aa62a6de req-e120a9da-4f91-48f0-9318-6fc4a0415032 service nova] Creating event network-vif-plugged:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:40:05.554054 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-d5783e51-a6ec-4606-9cb7-0258aa62a6de req-e120a9da-4f91-48f0-9318-6fc4a0415032 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032510 Feb 16 05:40:05.554731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 442/872] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:40:05.583102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:05.591453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:05.592968 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:05.594155 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-835f7fc2-b87e-4f46-8fc9-f81d512cc966 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.182339 Feb 16 05:40:05.594720 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 431/873] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:05 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:06.613390 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:06.614528 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:06.625529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:06.626670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:06.629145 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:06.629453 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:06.766447 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:06.774204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:06.775716 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:06.776873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7577e3d4-2042-4219-809e-d44766e11f62 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.168362 Feb 16 05:40:06.777473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 443/874] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:06 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:07.795170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:07.795805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:07.802035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:07.802482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:07.803254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:07.803689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:07.932252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:07.939889 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:07.941419 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:07.942556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8cd16f59-6ee8-44a2-9a8d-293efc5e466b tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.151746 Feb 16 05:40:07.943120 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 432/875] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:07 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:08.960303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:08.960815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:08.967030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:08.967474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:08.968237 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:08.968664 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:09.099702 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:09.107915 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:09.109441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:09.110583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9aba5e53-d4fc-425f-8c7a-5f5d8a7c31dc tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1730 microversion: 2.20 time: 0.154072 Feb 16 05:40:09.111134 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 444/876] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:08 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:10.129090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:10.129090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:10.135669 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:10.136125 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:10.136910 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:10.137380 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:10.272265 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:10.282631 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:10.284320 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:10.285594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2252bac1-8ce5-4589-aa2a-c8369e7dc44a tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1717 microversion: 2.20 time: 0.160793 Feb 16 05:40:10.286197 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 433/877] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:10 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:39.893279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:39.894212 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:39.900121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:39.900563 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:39.901361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:39.902310 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:39.930581 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7903f43a-18cf-421c-87bd-22cffdf45c76 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040948 Feb 16 05:40:39.931060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 445/878] 10.222.0.75 () {60 vars in 1342 bytes} [Wed Feb 16 05:40:39 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:40:39.985898 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:39.986383 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:39.992168 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:39.992617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:39.993418 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:39.993856 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:40.019398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:40:40.245547 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-9c7e247f-779d-45fe-b01a-b2a151182b55 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 204 len: 0 microversion: 2.20 time: 0.263017 Feb 16 05:40:40.246199 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 434/879] 10.222.0.75 () {60 vars in 1279 bytes} [Wed Feb 16 05:40:39 2022] DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:40:40.254711 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:40.255320 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:40.261691 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:40.262140 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:40.262920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:40.263359 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:40.391265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:40.399070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:40.400628 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:40.402443 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-33c9d38e-ce49-4bcc-ad49-08443a893044 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.151117 Feb 16 05:40:40.403003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 446/880] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:40 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 05:40:41.420950 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:41.421664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:41.428117 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:41.428559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:41.429350 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:41.429779 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:41.559917 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:41.567686 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:41.569192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:41.570374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-59c3f580-68ea-4096-b390-971e4a583296 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1723 microversion: 2.20 time: 0.153495 Feb 16 05:40:41.570928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 435/881] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:41 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:42.580507 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-75e1fe83-1ee0-4227-b1d7-e1481830b27c req-a0d3186e-12e9-4bf4-8e93-869b3682f4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c112142-abdc-4305-9f88-55a64404a86d", "name": "network-vif-deleted", "tag": "34a938ee-31c9-4981-a33b-0346248cbdca"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:40:42.582087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:40:42.582087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:40:42.589379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-75e1fe83-1ee0-4227-b1d7-e1481830b27c req-a0d3186e-12e9-4bf4-8e93-869b3682f4da service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:42.590334 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-75e1fe83-1ee0-4227-b1d7-e1481830b27c req-a0d3186e-12e9-4bf4-8e93-869b3682f4da service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:42.592014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:42.593182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:42.601666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:42.602082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-75e1fe83-1ee0-4227-b1d7-e1481830b27c req-a0d3186e-12e9-4bf4-8e93-869b3682f4da service nova] Creating event network-vif-deleted:34a938ee-31c9-4981-a33b-0346248cbdca for instance 5c112142-abdc-4305-9f88-55a64404a86d on hv-cinder-82947 Feb 16 05:40:42.602645 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:42.603646 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:42.604727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:42.607384 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-75e1fe83-1ee0-4227-b1d7-e1481830b27c req-a0d3186e-12e9-4bf4-8e93-869b3682f4da service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030401 Feb 16 05:40:42.608003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 447/882] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:40:42.683293 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:42.694101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:42.695838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d3207da0fb24b3f8f329b6837fd9376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0673600914ab1a0a8636e309c3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:40:42.697176 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f0284734-da7c-4c5c-a60f-9f341fdd8a81 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 200 len: 1656 microversion: 2.20 time: 0.111803 Feb 16 05:40:42.697797 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 436/883] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:42 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 1656 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 05:40:43.716294 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:43.716896 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:43.723887 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:43.724414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:43.725302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:43.725835 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:43.738903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. Feb 16 05:40:43.739495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:43.740326 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-da5109cb-0f55-4f3d-acf8-3a2d1bfea9b1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 404 len: 111 microversion: 2.20 time: 0.029026 Feb 16 05:40:43.740867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 448/884] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:43 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:43.749576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-63b2c9dd-3339-401a-a4ae-798fa4ea539c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '.version_select at 0x7fc5914163a0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:43.767394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-63b2c9dd-3339-401a-a4ae-798fa4ea539c tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280203672" status: 204 len: 0 microversion: 2.20 time: 0.022022 Feb 16 05:40:43.767944 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 437/885] 10.222.0.75 () {60 vars in 1261 bytes} [Wed Feb 16 05:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280203672 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 05:40:45.732143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:45.732731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:45.739208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:45.739656 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:45.740427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:45.740864 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:45.754648 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. Feb 16 05:40:45.755232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:45.756067 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a10c7316-6f37-4c25-a4e7-ec8396c30bef tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 404 len: 111 microversion: 2.20 time: 0.027658 Feb 16 05:40:45.756596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 449/886] 10.222.0.75 () {60 vars in 1279 bytes} [Wed Feb 16 05:40:45 2022] DELETE /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:45.765415 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:45.766016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 5c112142-abdc-4305-9f88-55a64404a86d] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:45.772222 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:45.772666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:45.773470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:45.773901 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:45.786363 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. Feb 16 05:40:45.786935 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 5c112142-abdc-4305-9f88-55a64404a86d could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:45.787728 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1975fed4-c02c-4f62-90e9-1457e5fa88a9 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d" status: 404 len: 111 microversion: 2.20 time: 0.027136 Feb 16 05:40:45.788233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 438/887] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:45 2022] GET /compute/v2.1/servers/5c112142-abdc-4305-9f88-55a64404a86d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:46.911753 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:46.912249 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:46.918480 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:46.918935 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:46.919744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:46.920177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:46.934452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. Feb 16 05:40:46.934971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:46.935778 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-56567be5-571c-43c1-ad8c-13e59274256d tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 404 len: 111 microversion: 2.20 time: 0.028878 Feb 16 05:40:46.936303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 450/888] 10.222.0.75 () {60 vars in 1279 bytes} [Wed Feb 16 05:40:46 2022] DELETE /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:46.944182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:46.944791 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] [instance: 03664210-52cd-4649-abb9-282e98802be3] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:40:46.951489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:46.951938 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:46.952706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:40:46.953146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:40:46.966610 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] HTTP exception thrown: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. Feb 16 05:40:46.967189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] Returning 404 to user: Instance 03664210-52cd-4649-abb9-282e98802be3 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:46.967995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-035d36ce-9932-478e-83b9-44543288a6a1 tempest-AttachVolumeShelveTestJSON-861541423 tempest-AttachVolumeShelveTestJSON-861541423-project] 10.222.0.75 "GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3" status: 404 len: 111 microversion: 2.20 time: 0.027516 Feb 16 05:40:46.968513 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 439/889] 10.222.0.75 () {60 vars in 1276 bytes} [Wed Feb 16 05:40:46 2022] GET /compute/v2.1/servers/03664210-52cd-4649-abb9-282e98802be3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:51.115458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-73e5e6b0-bacf-4aea-a800-290ac3ba26dc tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Action: 'create', calling method: .version_select at 0x7fc591dd08b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1530063588", "metadata": {"Type": "work"}}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:40:51.116910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-73e5e6b0-bacf-4aea-a800-290ac3ba26dc tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.117730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-73e5e6b0-bacf-4aea-a800-290ac3ba26dc tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.111129 Feb 16 05:40:51.118254 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 451/890] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:40:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:51.126916 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b99c870d-cc56-4b50-bbdc-a899fb831241 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Action: 'create', calling method: .version_select at 0x7fc5915265e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-710372394", "metadata": {"Type": "work"}}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:40:51.128310 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b99c870d-cc56-4b50-bbdc-a899fb831241 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.129128 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b99c870d-cc56-4b50-bbdc-a899fb831241 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005835 Feb 16 05:40:51.129688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 440/891] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:40:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:51.137243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0d997a9b-173a-4d4a-a8a3-a66a4c33f186 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Action: 'create', calling method: .version_select at 0x7fc596275a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-514409800", "metadata": {"Type": "work"}}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:40:51.138368 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0d997a9b-173a-4d4a-a8a3-a66a4c33f186 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.139138 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0d997a9b-173a-4d4a-a8a3-a66a4c33f186 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005225 Feb 16 05:40:51.139632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 452/892] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:40:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 05:40:51.147459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-689ba026-d1c5-44dd-a1df-c0df1245cc47 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Calling method '.version_select at 0x7fc591511ee0>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:51.174885 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-689ba026-d1c5-44dd-a1df-c0df1245cc47 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] HTTP exception thrown: Volume tempest-invalid-1136665072 could not be found. Feb 16 05:40:51.175464 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-689ba026-d1c5-44dd-a1df-c0df1245cc47 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 404 to user: Volume tempest-invalid-1136665072 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.176273 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-689ba026-d1c5-44dd-a1df-c0df1245cc47 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1136665072" status: 404 len: 99 microversion: 2.1 time: 0.032472 Feb 16 05:40:51.176800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 441/893] 10.222.0.75 () {58 vars in 1217 bytes} [Wed Feb 16 05:40:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1136665072 => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 16 05:40:51.186203 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-a96a69ce-6d93-4b33-baa9-64eeb7ef7075 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003489 Feb 16 05:40:51.186690 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 453/894] 10.222.0.75 () {58 vars in 1139 bytes} [Wed Feb 16 05:40:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 16 05:40:51.194903 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3c4645de-e664-457f-8462-d848b5c52a88 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003676 Feb 16 05:40:51.195537 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 442/895] 10.222.0.75 () {58 vars in 1136 bytes} [Wed Feb 16 05:40:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 16 05:40:51.203660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-aeeed803-2646-4299-bfd9-d1dca00bfa48 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Calling method '.version_select at 0x7fc591da03a0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:51.230675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-aeeed803-2646-4299-bfd9-d1dca00bfa48 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] HTTP exception thrown: Volume 7450bab2-d29d-461d-8dac-3f20084e489f could not be found. Feb 16 05:40:51.231259 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-aeeed803-2646-4299-bfd9-d1dca00bfa48 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 404 to user: Volume 7450bab2-d29d-461d-8dac-3f20084e489f could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.232073 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-aeeed803-2646-4299-bfd9-d1dca00bfa48 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/7450bab2-d29d-461d-8dac-3f20084e489f" status: 404 len: 109 microversion: 2.1 time: 0.031991 Feb 16 05:40:51.232600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 454/896] 10.222.0.75 () {58 vars in 1247 bytes} [Wed Feb 16 05:40:51 2022] DELETE /compute/v2.1/os-volumes/7450bab2-d29d-461d-8dac-3f20084e489f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:40:51.241250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-efcceb4b-7308-424a-8b4e-e2ec3183b8e6 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Calling method '.version_select at 0x7fc591526670>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:40:51.272102 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-efcceb4b-7308-424a-8b4e-e2ec3183b8e6 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] HTTP exception thrown: Volume 62cd1c09-90be-46ef-8453-dbd8ef4f7c96 could not be found. Feb 16 05:40:51.272794 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-efcceb4b-7308-424a-8b4e-e2ec3183b8e6 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] Returning 404 to user: Volume 62cd1c09-90be-46ef-8453-dbd8ef4f7c96 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:40:51.273664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-efcceb4b-7308-424a-8b4e-e2ec3183b8e6 tempest-VolumesNegativeTest-1575922713 tempest-VolumesNegativeTest-1575922713-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/62cd1c09-90be-46ef-8453-dbd8ef4f7c96" status: 404 len: 109 microversion: 2.1 time: 0.035929 Feb 16 05:40:51.274248 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 443/897] 10.222.0.75 () {58 vars in 1244 bytes} [Wed Feb 16 05:40:51 2022] GET /compute/v2.1/os-volumes/62cd1c09-90be-46ef-8453-dbd8ef4f7c96 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:41:11.255983 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:11.256537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:11.263540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:11.264131 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:11.264765 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:11.265208 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:11.288487 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:41:11.362671 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ababdefa-1d61-47d5-b07f-2b2655c6db2f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 204 len: 0 microversion: 2.1 time: 0.110603 Feb 16 05:41:11.363196 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 455/898] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:41:11 2022] DELETE /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:41:11.373927 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:11.375535 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:11.383852 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:11.384342 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:11.385136 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:11.385603 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:11.525432 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:11.534522 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a323cb64-c12e-45eb-bfa2-3e11b2682237 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1578 microversion: 2.1 time: 0.166780 Feb 16 05:41:11.535328 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 444/899] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:11 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:12.552171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:12.552860 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:12.559626 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:12.560074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:12.560924 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:12.561396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:12.706039 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:12.713878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6ff3c7d1-94a9-4527-991b-775676d26d32 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1578 microversion: 2.1 time: 0.165212 Feb 16 05:41:12.715300 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 456/900] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:12 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:13.732171 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:13.732817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:13.740315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:13.740830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:13.741911 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:13.742612 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:13.802504 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:13.810466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b9bff90d-8e33-479b-afa8-7deddfbc2c6e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1510 microversion: 2.1 time: 0.082410 Feb 16 05:41:13.811031 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 445/901] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:13 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1510 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:13.926214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-8566bb10-6e9b-435f-acad-f8d4bedaa8ca req-dfaac256-e88d-450f-abcf-0f7f47112602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5c79d1-09d2-4e14-b144-40a132b546d6", "name": "network-vif-deleted", "tag": "f42f8d9e-47f2-47ff-a24a-282b5e026e62"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:13.928105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:41:13.928105 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:41:13.938836 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-8566bb10-6e9b-435f-acad-f8d4bedaa8ca req-dfaac256-e88d-450f-abcf-0f7f47112602 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:13.939865 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-8566bb10-6e9b-435f-acad-f8d4bedaa8ca req-dfaac256-e88d-450f-abcf-0f7f47112602 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:13.953434 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-8566bb10-6e9b-435f-acad-f8d4bedaa8ca req-dfaac256-e88d-450f-abcf-0f7f47112602 service nova] Creating event network-vif-deleted:f42f8d9e-47f2-47ff-a24a-282b5e026e62 for instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 on hv-cinder-82947 Feb 16 05:41:13.961509 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-8566bb10-6e9b-435f-acad-f8d4bedaa8ca req-dfaac256-e88d-450f-abcf-0f7f47112602 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Feb 16 05:41:13.962590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 457/902] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:41:14.827024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:14.827641 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:14.833880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:14.834279 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:14.835065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:14.835509 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:14.865584 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:14.866039 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:14.866493 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lazy-loading 'fault' on Instance uuid 6a5c79d1-09d2-4e14-b144-40a132b546d6 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:41:14.905252 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:14.912702 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-30e93684-b4c7-4867-9962-dcae70ae9c6c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1231 microversion: 2.1 time: 0.089363 Feb 16 05:41:14.913283 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 446/903] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:14 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1231 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:15.931238 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:15.931857 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:15.938392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:15.938835 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:15.939600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:15.940033 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:15.969804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:15.970245 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:15.970686 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lazy-loading 'fault' on Instance uuid 6a5c79d1-09d2-4e14-b144-40a132b546d6 {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:41:16.009926 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:16.017840 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8f8e7163-9be8-42d3-9d74-d689bcf2295f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 200 len: 1231 microversion: 2.1 time: 0.091116 Feb 16 05:41:16.018403 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 458/904] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:15 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:17.034521 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:17.035323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:17.041872 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:17.042324 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:17.043655 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:17.044095 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:17.056843 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] HTTP exception thrown: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. Feb 16 05:41:17.057490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Returning 404 to user: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:41:17.058309 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e0316118-8b3d-4413-aec7-4a2f09e9c9d8 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 404 len: 111 microversion: 2.1 time: 0.027570 Feb 16 05:41:17.059451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 447/905] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:17 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:41:17.156299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-760009100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385593991", "security_groups": [{"name": "tempest-secgroup-smoke-2011454409"}], "block_device_mapping_v2": [{"uuid": "a3871864-c627-4979-a33b-db02093eeca7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af5e8334-9cb2-4ddc-b153-43f6f162f135"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:17.274874 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] validate_networks() for [('af5e8334-9cb2-4ddc-b153-43f6f162f135', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:41:17.635213 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:41:17.635680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:41:17.636158 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:41:17.637086 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:41:17.637534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:41:17.646092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:17.646545 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:17.647362 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:17.647804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:17.664407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:41:17.668529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for user 87279464d1b74c0d88c95f4dec9871ae and project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:41:17.730555 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:41:17.732977 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3871864-c627-4979-a33b-db02093eeca7',volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:41:17.850636 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [ea76b5df-b7fa-459c-b29d-6a4201e31eb0] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 16 05:41:18.857879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [ea76b5df-b7fa-459c-b29d-6a4201e31eb0] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 60672. Feb 16 05:41:18.861683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f5dacc77-12dd-45cc-bb50-3c1a2bf627dd tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.709466 Feb 16 05:41:18.862373 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 459/906] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:41:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:41:18.872672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-362f6510-69ba-4630-965a-e70a84c80b8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:18.873296 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-362f6510-69ba-4630-965a-e70a84c80b8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:18.923744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-362f6510-69ba-4630-965a-e70a84c80b8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:18.930163 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-362f6510-69ba-4630-965a-e70a84c80b8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1094 microversion: 2.1 time: 0.061787 Feb 16 05:41:18.930710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 448/907] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:18 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:19.947604 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-164b7791-7ce5-4781-b59e-3acb2d8c2e9b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:19.948216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-164b7791-7ce5-4781-b59e-3acb2d8c2e9b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:19.999933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-164b7791-7ce5-4781-b59e-3acb2d8c2e9b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:20.006954 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-164b7791-7ce5-4781-b59e-3acb2d8c2e9b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1094 microversion: 2.1 time: 0.063337 Feb 16 05:41:20.007645 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 460/908] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:19 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:21.023482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-fd8b0ec6-c15c-4d59-807b-6c702de16c8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:21.024096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-fd8b0ec6-c15c-4d59-807b-6c702de16c8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:21.081040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-fd8b0ec6-c15c-4d59-807b-6c702de16c8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:21.090588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-fd8b0ec6-c15c-4d59-807b-6c702de16c8f tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1094 microversion: 2.1 time: 0.070718 Feb 16 05:41:21.091147 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 449/909] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:21 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:22.107286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-31b8afda-4416-43d3-a446-53750bb154de tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:22.107892 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-31b8afda-4416-43d3-a446-53750bb154de tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:22.161877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-31b8afda-4416-43d3-a446-53750bb154de tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:22.171147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-31b8afda-4416-43d3-a446-53750bb154de tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1094 microversion: 2.1 time: 0.067640 Feb 16 05:41:22.171718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 461/910] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:22 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:23.188767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:23.189406 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:23.195411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:23.195865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:23.196650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:23.197090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:23.255139 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:23.262949 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-5c824870-9c57-4b0b-8f7f-98928fb8260d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1144 microversion: 2.1 time: 0.077232 Feb 16 05:41:23.263490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 450/911] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:23 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:24.281156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:24.281156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:24.287516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:24.287988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:24.289030 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:24.289486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:24.380494 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:24.388436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bab489f3-c2e7-4de7-8924-d4e54309ce60 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1210 microversion: 2.1 time: 0.112521 Feb 16 05:41:24.398232 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 462/912] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:24 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:25.214305 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-f6fecbf4-9e75-4850-80db-edb454c00d57 req-3db37ebe-ee03-4e2d-82c0-4e682df85101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd96ae9-65c0-4ea7-a034-c783711160d9", "tag": "04216612-6a17-42d7-bf1b-e4c80f38b38d"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:25.224442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:41:25.224442 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:41:25.241681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-f6fecbf4-9e75-4850-80db-edb454c00d57 req-3db37ebe-ee03-4e2d-82c0-4e682df85101 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:25.243370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-f6fecbf4-9e75-4850-80db-edb454c00d57 req-3db37ebe-ee03-4e2d-82c0-4e682df85101 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:25.257635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-f6fecbf4-9e75-4850-80db-edb454c00d57 req-3db37ebe-ee03-4e2d-82c0-4e682df85101 service nova] Creating event network-changed:04216612-6a17-42d7-bf1b-e4c80f38b38d for instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 on hv-cinder-82947 Feb 16 05:41:25.263500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-f6fecbf4-9e75-4850-80db-edb454c00d57 req-3db37ebe-ee03-4e2d-82c0-4e682df85101 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059470 Feb 16 05:41:25.264226 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 451/913] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:41:25.405660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:25.406360 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:25.412550 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:25.413006 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:25.414068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:25.414498 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:25.635421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:25.642565 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-674f15a8-985b-46a1-8de1-2fe431c5631b tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.240640 Feb 16 05:41:25.643128 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 463/914] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:25 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:26.660477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:26.661124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:26.667544 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:26.667995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:26.668783 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:26.669222 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:26.808551 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:26.815818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d736d253-9acf-4d33-a512-ac189fcaedbc tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.159885 Feb 16 05:41:26.816377 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 452/915] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:26 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:27.832811 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:27.833450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:27.839746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:27.840193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:27.840963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:27.841424 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:27.973406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:27.980558 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-131a58ea-05f7-4277-80cd-acaa2d46504e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.151461 Feb 16 05:41:27.981282 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 464/916] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:27 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:28.999280 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:29.000005 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:29.006502 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:29.006957 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:29.007747 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:29.008189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:29.381907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:29.392060 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-1282a893-418e-438b-8240-6c5dd18599f0 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.398109 Feb 16 05:41:29.392644 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 453/917] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:28 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:30.408652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:30.410087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:30.418015 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:30.419597 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:30.421149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:30.422329 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:30.565861 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:30.573148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9d748189-6c36-4453-827a-28343f60279a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.168387 Feb 16 05:41:30.573743 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 465/918] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:30 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:41:31.591146 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:31.591765 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:31.598527 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:31.598950 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:31.599808 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:31.600378 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:31.878754 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:31.889498 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-087974d8-c14d-42f1-80c8-aa34aac4f2ca tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.302973 Feb 16 05:41:31.890660 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 454/919] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:31 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:32.907736 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:32.908273 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:32.915055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:32.915608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:32.916997 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:32.918106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:33.066595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:33.078537 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f4eac04d-0e4d-44df-948e-419d2b192c62 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.175533 Feb 16 05:41:33.079914 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 466/920] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:32 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:34.097375 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:34.098707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:34.108008 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:34.110571 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:34.115360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:34.116209 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:34.383709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:34.397191 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0227916e-b320-4358-aceb-ff14e2a3a55d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.304042 Feb 16 05:41:34.405860 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 455/921] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:34 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:35.415402 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:35.416129 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:35.422801 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:35.423263 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:35.424061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:35.424679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:35.653868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:35.661366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0e8553cc-45ec-46a4-8ab2-5561b92aad1c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.250122 Feb 16 05:41:35.662040 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 467/922] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:35 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:36.566982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-28782426-3b31-487c-9d48-806e63f6f787 req-3f9d7110-09de-4363-afc1-3fa00566b20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd96ae9-65c0-4ea7-a034-c783711160d9", "name": "network-vif-plugged", "status": "completed", "tag": "04216612-6a17-42d7-bf1b-e4c80f38b38d"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:36.570292 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:41:36.570292 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:41:36.582710 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-28782426-3b31-487c-9d48-806e63f6f787 req-3f9d7110-09de-4363-afc1-3fa00566b20b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:36.583500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-28782426-3b31-487c-9d48-806e63f6f787 req-3f9d7110-09de-4363-afc1-3fa00566b20b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:36.597300 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-28782426-3b31-487c-9d48-806e63f6f787 req-3f9d7110-09de-4363-afc1-3fa00566b20b service nova] Creating event network-vif-plugged:04216612-6a17-42d7-bf1b-e4c80f38b38d for instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 on hv-cinder-82947 Feb 16 05:41:36.604450 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-28782426-3b31-487c-9d48-806e63f6f787 req-3f9d7110-09de-4363-afc1-3fa00566b20b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041985 Feb 16 05:41:36.605722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 456/923] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:41:36.678445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:36.680269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:36.687496 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:36.688341 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:36.689482 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:36.690201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:36.997181 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:37.022363 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7074810d-4225-41fe-b74d-553f4eae4d71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.344428 Feb 16 05:41:37.025331 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 468/924] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:36 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:38.047790 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:38.049805 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:38.060787 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:38.063438 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:38.064955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:38.065699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:38.386324 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:38.395456 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-58db2105-4f9f-45af-85ba-f13fd2f245f9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1266 microversion: 2.1 time: 0.358658 Feb 16 05:41:38.396784 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 457/925] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:38 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:39.412706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:39.413624 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:39.424882 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:39.425659 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:39.428064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:39.428789 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:39.590950 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:39.599622 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eafae010-978b-4e15-8a94-0d84400f27e9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1452 microversion: 2.1 time: 0.190814 Feb 16 05:41:39.611150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 469/926] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:39 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:39.615965 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:39.616866 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:39.624011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:39.624697 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:39.625526 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:39.625964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:39.845182 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:39.852677 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7ac00a51-622d-45ef-924c-5f11ecaf01b1 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1452 microversion: 2.1 time: 0.240408 Feb 16 05:41:39.853918 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 458/927] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:39 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:41:42.229666 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-fba96453-78c7-4642-872f-780276a514b4 req-7b68b4e3-3b67-43d7-be9f-62c1a5aa3e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd96ae9-65c0-4ea7-a034-c783711160d9", "tag": "04216612-6a17-42d7-bf1b-e4c80f38b38d"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:42.231643 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:41:42.231643 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:41:42.244464 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-fba96453-78c7-4642-872f-780276a514b4 req-7b68b4e3-3b67-43d7-be9f-62c1a5aa3e29 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:42.245068 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-fba96453-78c7-4642-872f-780276a514b4 req-7b68b4e3-3b67-43d7-be9f-62c1a5aa3e29 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:42.264406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-fba96453-78c7-4642-872f-780276a514b4 req-7b68b4e3-3b67-43d7-be9f-62c1a5aa3e29 service nova] Creating event network-changed:04216612-6a17-42d7-bf1b-e4c80f38b38d for instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 on hv-cinder-82947 Feb 16 05:41:42.272970 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-fba96453-78c7-4642-872f-780276a514b4 req-7b68b4e3-3b67-43d7-be9f-62c1a5aa3e29 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048408 Feb 16 05:41:42.274182 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 470/928] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:41:49.749249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'create', calling method: .version_select at 0x7fc591416310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1333849192"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:49.763093 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for project ba122c4197da463faf4c622f2ba7087c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:41:49.766906 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for user 584d2cb873f74a1094a192f8de8f0451 and project ba122c4197da463faf4c622f2ba7087c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:41:50.507983 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for project ba122c4197da463faf4c622f2ba7087c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:41:50.512449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for user 584d2cb873f74a1094a192f8de8f0451 and project ba122c4197da463faf4c622f2ba7087c. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:41:50.525108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d2494123-e16c-4927-bdb0-318f490663e2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.779648 Feb 16 05:41:50.525737 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 459/929] 10.222.0.75 () {60 vars in 1157 bytes} [Wed Feb 16 05:41:49 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:50.574820 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1034332641", "imageRef": "f4470264-68ce-498c-bb62-0bc1314172ea", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1333849192", "networks": [{"uuid": "0b0691c0-8422-407b-956a-b27b220175f4"}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:41:50.624129 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] validate_networks() for [('0b0691c0-8422-407b-956a-b27b220175f4', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:41:50.986314 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:41:50.986741 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:41:50.987244 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:41:50.987654 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:41:50.988064 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:41:50.997088 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:50.997573 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:50.998387 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:50.998826 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:51.019083 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for project ba122c4197da463faf4c622f2ba7087c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:41:51.023166 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Getting quotas for user 584d2cb873f74a1094a192f8de8f0451 and project ba122c4197da463faf4c622f2ba7087c. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:41:51.034082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:41:51.036407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f4470264-68ce-498c-bb62-0bc1314172ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:41:51.080899 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-da39b1bf-96f8-445d-9ce7-ee3dab94bad3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510627 Feb 16 05:41:51.081570 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 471/930] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:41:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:41:51.091741 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f0ad48e4-bb45-4ff5-9fc2-836ee53594cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:51.092356 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f0ad48e4-bb45-4ff5-9fc2-836ee53594cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:51.147531 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f0ad48e4-bb45-4ff5-9fc2-836ee53594cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:51.154616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f0ad48e4-bb45-4ff5-9fc2-836ee53594cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1259 microversion: 2.1 time: 0.067041 Feb 16 05:41:51.155539 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 460/931] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:51 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:52.172697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:52.173420 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:52.180849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:52.181326 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:52.182115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:52.182549 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:52.280485 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:52.288049 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e1973472-d628-4754-8b8c-6047642de383 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1317 microversion: 2.1 time: 0.120084 Feb 16 05:41:52.288699 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 472/932] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:52 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1317 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:41:53.305684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:53.306317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:53.312683 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:53.313143 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:53.313994 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:53.314435 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:53.454533 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:53.463010 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e69c3c2b-e3a1-4077-9da3-9cb77e801731 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.161093 Feb 16 05:41:53.464084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 461/933] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:53 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:54.479683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:54.480798 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:54.487133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:54.487533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:54.488412 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:54.488954 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:54.627862 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:54.635319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-44626a3e-8ab3-4d2c-b75b-5d9cfcf57d99 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.159243 Feb 16 05:41:54.635888 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 473/934] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:54 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:55.651441 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:55.652254 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:55.658821 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:55.659277 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:55.660070 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:55.660511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:55.851178 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:55.859255 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b04e8e7e-79b7-49fa-a25a-6c91daeca2e7 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.211894 Feb 16 05:41:55.860359 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 462/935] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:55 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:56.876265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:56.876902 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:56.883320 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:56.883766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:56.884544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:56.884974 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:57.038587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:57.046953 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f7a367c3-fb43-40f3-a1c5-464b09d6e380 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.175004 Feb 16 05:41:57.047533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 474/936] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:56 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:41:58.064081 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:58.064978 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:58.071616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:58.072145 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:58.073022 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:58.073563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:58.212844 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:58.220602 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f19a786b-6a44-42ad-99dd-faa44469822e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.160174 Feb 16 05:41:58.221332 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 463/937] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:58 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:41:59.237174 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:41:59.238010 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:41:59.244321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:59.244776 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:59.245600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:41:59.246037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:41:59.391821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:41:59.399361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-8bd143f3-57c1-4e60-9f7c-648b11108f21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.165863 Feb 16 05:41:59.399936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 475/938] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:41:59 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:00.415929 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:00.416630 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:00.423374 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:00.423817 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:00.424593 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:00.425021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:00.561377 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:00.568830 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ffdc6e56-3210-4017-91b7-da4077dc5673 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.156785 Feb 16 05:42:00.569407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 464/939] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:00 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:01.585113 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:01.585760 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:01.592089 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:01.592544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:01.593349 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:01.593790 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:01.721810 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:01.729162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-10f81398-e481-4366-8026-09a7d3031d45 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.147671 Feb 16 05:42:01.729779 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 476/940] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:01 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:02.347217 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-b6d20e45-02f3-446d-962b-925d76da23a1 req-51fb3f25-62ee-4813-975d-e07291f10da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:02.348789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:42:02.348789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:42:02.356398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b6d20e45-02f3-446d-962b-925d76da23a1 req-51fb3f25-62ee-4813-975d-e07291f10da8 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:02.357240 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-b6d20e45-02f3-446d-962b-925d76da23a1 req-51fb3f25-62ee-4813-975d-e07291f10da8 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:02.369111 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-b6d20e45-02f3-446d-962b-925d76da23a1 req-51fb3f25-62ee-4813-975d-e07291f10da8 service nova] Creating event network-changed:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:42:02.379097 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-b6d20e45-02f3-446d-962b-925d76da23a1 req-51fb3f25-62ee-4813-975d-e07291f10da8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035741 Feb 16 05:42:02.380734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 465/941] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:02.745762 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:02.746412 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:02.753161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:02.753652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:02.754444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:02.754891 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:02.915647 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:02.923500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-abced74e-8bb8-4c1c-9a22-83b2e4ea5ccc tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.181468 Feb 16 05:42:02.924071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 477/942] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:02 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:03.940687 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:03.941318 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:03.947354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:03.947800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:03.948562 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:03.948989 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:04.081922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:04.089077 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-54da937a-1dbc-463d-9d51-bfd806914e33 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.152905 Feb 16 05:42:04.089676 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 466/943] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:03 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:05.106912 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:05.107528 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:05.113815 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:05.114295 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:05.115079 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:05.115520 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:05.250277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:05.257450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2ab027fd-5ebf-4b67-9140-c35fbd463584 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.154704 Feb 16 05:42:05.258021 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 478/944] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:05 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:06.273939 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:06.274583 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:06.280732 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:06.281185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:06.281999 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:06.282434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:06.416524 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:06.423843 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d4f96e2c-7823-4643-b703-b4563f9d7247 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.153680 Feb 16 05:42:06.424410 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 467/945] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:06 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:07.439783 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:07.440392 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:07.446641 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:07.447095 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:07.447870 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:07.448308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:07.577400 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:07.584516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e6dd7913-c794-4227-ac1d-38b74b097236 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.148463 Feb 16 05:42:07.585074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 479/946] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:07 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:08.467489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-07f15c06-e696-45a4-b690-6719cfe18a8b req-303d7ce2-bc01-4ffb-a5f0-26abfe81bd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "name": "network-vif-plugged", "status": "completed", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:08.469072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:42:08.469072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:42:08.476809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-07f15c06-e696-45a4-b690-6719cfe18a8b req-303d7ce2-bc01-4ffb-a5f0-26abfe81bd31 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:08.477316 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-07f15c06-e696-45a4-b690-6719cfe18a8b req-303d7ce2-bc01-4ffb-a5f0-26abfe81bd31 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:08.489565 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-07f15c06-e696-45a4-b690-6719cfe18a8b req-303d7ce2-bc01-4ffb-a5f0-26abfe81bd31 service nova] Creating event network-vif-plugged:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:42:08.494523 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-07f15c06-e696-45a4-b690-6719cfe18a8b req-303d7ce2-bc01-4ffb-a5f0-26abfe81bd31 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031166 Feb 16 05:42:08.495106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 468/947] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:08.600667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:08.602183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:08.608889 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:08.609590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:08.610451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:08.611133 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:08.804901 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:08.812156 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6c73fc7f-ba0d-4d4f-bdfc-7a925a61a68c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.215339 Feb 16 05:42:08.812719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 480/948] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:08 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:09.829233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:09.830130 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:09.836412 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:09.836993 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:09.838094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:09.838563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:09.972616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:09.980032 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-38f340bc-a6a1-4f96-9384-b881e1c0a85f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1359 microversion: 2.1 time: 0.155411 Feb 16 05:42:09.981242 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 469/949] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:09 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:10.997711 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:10.998279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:11.004630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.005081 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.005878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.006309 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.135003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:11.142139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-93afe79e-97fe-461e-96bd-b4516e22c5f1 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1550 microversion: 2.1 time: 0.148832 Feb 16 05:42:11.142697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 481/950] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:10 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:11.158181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:11.158800 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:11.165511 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.165967 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.166752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.167189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.306243 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:11.314026 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ebea76a4-cd3c-4ed9-948c-8ad5d3223f08 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1550 microversion: 2.1 time: 0.159512 Feb 16 05:42:11.314594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 470/951] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:11 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:11.334867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:11.338670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:42:11.338670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:42:11.339666 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:11.340441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Searching by: {'deleted': False, 'project_id': 'ba122c4197da463faf4c622f2ba7087c'} {{(pid=122878) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 16 05:42:11.346957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.347407 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.348303 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.348744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.436875 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.multi_cell_list [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122878) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 16 05:42:11.537027 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0001af48-7b92-4717-b227-666ca08285cf tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210735 Feb 16 05:42:11.537914 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 482/952] 10.222.0.75 () {58 vars in 1124 bytes} [Wed Feb 16 05:42:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:11.550564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:11.552270 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:11.558466 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.559487 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.560269 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:11.560708 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:11.697250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:11.708210 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-69bea8dd-291d-4cc3-b1ec-892f8be6f054 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1550 microversion: 2.1 time: 0.163357 Feb 16 05:42:11.708795 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 471/953] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:11 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:13.194243 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d59bee-a7d8-4409-b835-c70cf0c64e96"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:13.195300 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:13.201534 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:13.201995 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:13.202780 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:13.203221 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:13.438685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e5917cdd-b520-4bfe-b2a7-d20a91e3ad3c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247993 Feb 16 05:42:13.439292 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 483/954] 10.222.0.75 () {60 vars in 1322 bytes} [Wed Feb 16 05:42:13 2022] POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:20.938073 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:20.938751 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:20.945094 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:20.945588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:20.946371 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:20.946809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:21.079327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:21.087121 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e2703477-4ae4-43af-b2ee-997f6c696a26 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1596 microversion: 2.1 time: 0.152703 Feb 16 05:42:21.087695 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 472/955] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:20 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1596 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:22.981933 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-e1b012db-0d4e-4aaa-8e36-134f7a6c4556 req-31160d8c-6926-485a-9b2a-62aea416eb4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:22.983630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:42:22.983630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:42:22.990969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-e1b012db-0d4e-4aaa-8e36-134f7a6c4556 req-31160d8c-6926-485a-9b2a-62aea416eb4f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:22.991663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-e1b012db-0d4e-4aaa-8e36-134f7a6c4556 req-31160d8c-6926-485a-9b2a-62aea416eb4f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:23.002807 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-e1b012db-0d4e-4aaa-8e36-134f7a6c4556 req-31160d8c-6926-485a-9b2a-62aea416eb4f service nova] Creating event network-changed:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:42:23.007841 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-e1b012db-0d4e-4aaa-8e36-134f7a6c4556 req-31160d8c-6926-485a-9b2a-62aea416eb4f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030529 Feb 16 05:42:23.008634 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 484/956] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:24.026919 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1769628344"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:24.027471 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:24.034150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:24.034600 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:24.035392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:24.035832 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:24.177004 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.network.security_group_api [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Adding security group 70ec880e-a684-436c-a41e-da1a6e390bba to port d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 Feb 16 05:42:24.517084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-fd91d3f1-db9a-4b60-9ef4-c334d34c5743 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action" status: 202 len: 0 microversion: 2.1 time: 0.494121 Feb 16 05:42:24.518706 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 473/957] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:42:24 2022] POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:42:24.527708 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:24.528414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:24.537459 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-1657ea65-3614-4535-aa97-94bbe44eeda9 req-18671725-e505-4782-9a3f-e6deac03161b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:24.539500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:42:24.539500 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:42:24.545157 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:24.545679 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:24.546472 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:24.546586 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1657ea65-3614-4535-aa97-94bbe44eeda9 req-18671725-e505-4782-9a3f-e6deac03161b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:24.546908 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:24.547016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-1657ea65-3614-4535-aa97-94bbe44eeda9 req-18671725-e505-4782-9a3f-e6deac03161b service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:24.558306 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-1657ea65-3614-4535-aa97-94bbe44eeda9 req-18671725-e505-4782-9a3f-e6deac03161b service nova] Creating event network-changed:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:42:24.564579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-1657ea65-3614-4535-aa97-94bbe44eeda9 req-18671725-e505-4782-9a3f-e6deac03161b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031014 Feb 16 05:42:24.565684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 474/958] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:42:24.816818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:24.825049 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b03c6263-dcf3-401b-b5d1-a071495c8b2d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1761 microversion: 2.1 time: 0.302112 Feb 16 05:42:24.825892 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 485/959] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:24 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1761 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:47.420365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:42:47.421389 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:47.427564 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:47.428014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:47.428789 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:47.429225 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:47.499423 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-74b1f633-330c-4350-8798-764ce457a44c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action" status: 202 len: 0 microversion: 2.1 time: 0.082613 Feb 16 05:42:47.500040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 475/960] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:42:47 2022] POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:42:47.508065 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:47.508683 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:47.515401 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:47.515804 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:47.516704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:47.517148 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:47.747014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:47.755478 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-eb52cd5f-df0e-46a1-a32c-997eb6acb3c9 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1753 microversion: 2.1 time: 0.251110 Feb 16 05:42:47.756139 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 486/961] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:47 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:42:48.772276 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:48.772979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:48.779560 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:48.780016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:48.780798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:48.781239 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:48.927724 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:48.935351 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f2a4f99d-9995-48d6-a496-7ee1557b4f7f tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.167105 Feb 16 05:42:48.936411 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 476/962] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:48 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:49.953236 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:49.953808 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:49.960014 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:49.960458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:49.961220 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:49.961675 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:50.106777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:50.114638 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-df1f51e5-8d02-40a3-a217-6bc4358b7218 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.165606 Feb 16 05:42:50.115212 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 487/963] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:49 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:51.131563 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:51.132206 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:51.138534 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:51.138982 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:51.139761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:51.140201 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:51.282040 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:51.289969 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-005ed385-504f-4fda-b98d-a8d0d6848dfa tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.162081 Feb 16 05:42:51.290538 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 477/964] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:51 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:52.306405 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:52.307003 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:52.313629 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:52.314070 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:52.314831 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:52.315259 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:52.458296 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:52.465972 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-05485843-f860-467f-9da6-03129da92951 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.163242 Feb 16 05:42:52.466547 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 488/965] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:52 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:53.483255 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:53.483843 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:53.489918 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:53.490362 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:53.491181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:53.491616 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:53.638057 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:53.645858 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0cceb9e9-487e-4c44-b886-3d6163d59925 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.166718 Feb 16 05:42:53.646425 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 478/966] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:53 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:54.662856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:54.663471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:54.670418 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:54.670869 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:54.671660 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:54.672336 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:54.821371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:54.829321 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-17f92b25-51e8-454f-9f88-bac685b157b2 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.170367 Feb 16 05:42:54.829904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 489/967] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:54 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:55.845992 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:55.846637 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:55.853047 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:55.853542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:55.854376 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:55.854814 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:56.004977 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:56.012773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cd9df288-a561-4b24-8bcd-12a4cb507cc5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.170385 Feb 16 05:42:56.013439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 479/968] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:55 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:57.030185 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:57.030723 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:57.037380 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:57.037841 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:57.038620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:57.039061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:57.184059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:57.191880 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f688252a-fb14-4047-b7c5-5f3fdc5f8080 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.165999 Feb 16 05:42:57.192465 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 490/969] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:57 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:58.208972 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:58.209606 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:58.215954 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:58.216401 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:58.217838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:58.218277 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:58.365494 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:58.373825 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ef316f20-fc23-4091-997d-1a3cae3af144 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.168491 Feb 16 05:42:58.374393 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 480/970] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:58 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:42:59.390310 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:42:59.390923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:42:59.397230 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:59.397706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:59.398483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:42:59.398923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:42:59.543677 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:42:59.551406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-20c2b16e-c1cb-4218-80c5-b6d5bcc42447 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.164751 Feb 16 05:42:59.551973 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 491/971] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:42:59 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:00.567966 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:00.568581 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:00.574947 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:00.575400 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:00.576806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:00.577238 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:00.722857 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:00.730716 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-90cc6b74-f13a-4e89-9850-a0accb06912e tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.166388 Feb 16 05:43:00.731287 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 481/972] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:00 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:01.749756 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:01.750458 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:01.756966 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:01.757467 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:01.758254 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:01.758697 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:01.903567 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:01.911176 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c3402ede-2918-4d36-b82b-4b718961ff21 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.166831 Feb 16 05:43:01.912017 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 492/973] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:01 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:02.928433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:02.928961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:02.935205 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:02.935650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:02.936428 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:02.936842 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:03.077063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:03.084734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-05036b12-ed60-42dd-b2cb-b85f41be2868 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1758 microversion: 2.1 time: 0.160043 Feb 16 05:43:03.085449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 482/974] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:02 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:04.100976 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:04.101617 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:04.107867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:04.108317 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:04.109087 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:04.109608 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:04.251454 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:04.259216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-416effdc-c217-41fb-af2e-2d5aa2a05599 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1761 microversion: 2.1 time: 0.161899 Feb 16 05:43:04.259792 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 493/975] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:04 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:05.749204 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:43:05.749734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:43:28.484773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1439990612", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1385593991", "security_groups": [{"name": "tempest-secgroup-smoke-2011454409"}], "block_device_mapping_v2": [{"uuid": "803309aa-47d7-43d6-9ff6-1eb0f5712e58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af5e8334-9cb2-4ddc-b153-43f6f162f135"}]}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:28.755037 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.network.neutron [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] validate_networks() for [('af5e8334-9cb2-4ddc-b153-43f6f162f135', None, None, None, None, None)] {{(pid=122879) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:43:29.181274 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:43:29.181700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image limits 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:43:29.182193 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Flavor pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:43:29.182594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Image pref 0:0:0 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:43:29.182996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.virt.hardware [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:43:29.191329 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:29.191774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:29.192573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:29.193000 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:29.208934 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:43:29.212804 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Getting quotas for user 87279464d1b74c0d88c95f4dec9871ae and project 7e5222e96e134b27b8a588f1309a0097. Resources: {'ram', 'cores', 'instances'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:43:29.269484 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Going to run 1 instances... {{(pid=122879) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:43:29.271589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='803309aa-47d7-43d6-9ff6-1eb0f5712e58',volume_size=None,volume_type=None)] {{(pid=122879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:43:29.392031 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-eaa3d96d-80f2-4288-8ae4-c004667fc970 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.910900 Feb 16 05:43:29.392761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 483/976] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:43:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:43:29.402936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-feb268c0-235d-4afc-87b8-37967c6e1614 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:29.403546 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-feb268c0-235d-4afc-87b8-37967c6e1614 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:29.527016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-feb268c0-235d-4afc-87b8-37967c6e1614 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:29.533661 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-feb268c0-235d-4afc-87b8-37967c6e1614 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1095 microversion: 2.1 time: 0.134564 Feb 16 05:43:29.534324 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 494/977] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:29 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1095 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:30.552426 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:30.553106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:30.560071 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:30.560584 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:30.561795 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:30.562298 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:30.622731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:30.630530 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-350958c0-ede8-4423-8bb1-06e36f4d618a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1211 microversion: 2.1 time: 0.082492 Feb 16 05:43:30.631249 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 484/978] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:30 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:31.648611 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:31.649860 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:31.660356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:31.660752 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:31.661969 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:31.662411 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:31.886048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:31.894334 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-730aedd9-c6d2-4a0d-9ace-4489dd192330 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.250269 Feb 16 05:43:31.894938 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 495/979] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:31 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:43:31.948614 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-a1055f21-01e5-4513-b20d-9a2ea6b6b79f req-a4556678-d731-48b3-9b09-2b1df65a906d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97656735-cb10-4bd1-b2dd-8ed733784a21", "tag": "904032fd-091e-48cf-b168-d47fb2b17635"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:31.950233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:31.950233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:43:31.958776 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-a1055f21-01e5-4513-b20d-9a2ea6b6b79f req-a4556678-d731-48b3-9b09-2b1df65a906d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:31.959773 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-a1055f21-01e5-4513-b20d-9a2ea6b6b79f req-a4556678-d731-48b3-9b09-2b1df65a906d service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:31.971694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-a1055f21-01e5-4513-b20d-9a2ea6b6b79f req-a4556678-d731-48b3-9b09-2b1df65a906d service nova] Creating event network-changed:904032fd-091e-48cf-b168-d47fb2b17635 for instance 97656735-cb10-4bd1-b2dd-8ed733784a21 on hv-cinder-82947 Feb 16 05:43:31.976763 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-a1055f21-01e5-4513-b20d-9a2ea6b6b79f req-a4556678-d731-48b3-9b09-2b1df65a906d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031844 Feb 16 05:43:31.977392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 485/980] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:43:32.912383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:32.913001 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:32.919216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:32.919672 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:32.920461 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:32.920904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:33.052503 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:33.059671 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-23424e86-675d-4f93-ae1e-068275eb51c6 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.151269 Feb 16 05:43:33.060262 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 496/981] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:32 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:34.078011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:34.078709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:34.084779 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:34.085235 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:34.086034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:34.086472 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:34.223575 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:34.230824 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-12f9a900-1337-496e-acc1-707193d5b08e tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.157894 Feb 16 05:43:34.231722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 486/982] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:34 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:35.301445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:35.302066 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:35.307824 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:35.308277 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:35.309059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:35.309530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:35.440518 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:35.447799 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-9568d887-7e3c-474b-9cdd-076e2e53541c tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.203795 Feb 16 05:43:35.448371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 497/983] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:35 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:36.464943 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:36.465595 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:36.472367 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:36.472821 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:36.473633 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:36.474072 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:36.610653 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:36.617900 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-65b228c3-225b-4b59-844e-e5a8703a3f00 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.156771 Feb 16 05:43:36.618463 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 487/984] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:36 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:37.004154 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1769628344"}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:37.004729 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:37.010929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:37.011391 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:37.012169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:37.012607 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:37.404746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.network.security_group_api [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Removing security group 70ec880e-a684-436c-a41e-da1a6e390bba from port d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 Feb 16 05:43:37.634367 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:37.634913 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:37.641633 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:37.642074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:37.642839 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:37.643268 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:37.741179 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ccf2a3d8-a41a-4e71-a13d-31bb2f699331 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action" status: 202 len: 0 microversion: 2.1 time: 0.740768 Feb 16 05:43:37.745045 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 498/985] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:43:36 2022] POST /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:43:37.846575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-7731d53e-60d9-43ad-8524-fb72ce9e8980 req-06a412fe-9dd1-4b46-9ff4-a416be9704c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:37.848414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:37.848414 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:43:37.856571 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-7731d53e-60d9-43ad-8524-fb72ce9e8980 req-06a412fe-9dd1-4b46-9ff4-a416be9704c9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:37.857201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-7731d53e-60d9-43ad-8524-fb72ce9e8980 req-06a412fe-9dd1-4b46-9ff4-a416be9704c9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:37.860862 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:37.869560 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-7731d53e-60d9-43ad-8524-fb72ce9e8980 req-06a412fe-9dd1-4b46-9ff4-a416be9704c9 service nova] Creating event network-changed:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:43:37.873477 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2252c65e-99a6-48db-8209-e8906f816151 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.238240 Feb 16 05:43:37.876714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 488/986] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:37 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:43:37.876957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-7731d53e-60d9-43ad-8524-fb72ce9e8980 req-06a412fe-9dd1-4b46-9ff4-a416be9704c9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113149 Feb 16 05:43:37.880395 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 499/987] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:43:38.890666 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:38.891284 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:38.897491 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:38.897939 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:38.898713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:38.899148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.031200 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:39.039736 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-db6e14b9-4318-4fce-8768-0d745a9733c4 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.152720 Feb 16 05:43:39.040314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 489/988] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:38 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:39.183269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:39.183843 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:39.189992 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:39.190437 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.191204 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:39.191632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.271511 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lazy-loading 'services' on Instance uuid 406bec91-5d24-4662-8c2b-202a785d249f {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:43:39.340525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-53a8a79b-9840-4915-9b97-07aae5816fb5 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments/12d59bee-a7d8-4409-b835-c70cf0c64e96" status: 202 len: 0 microversion: 2.1 time: 0.161634 Feb 16 05:43:39.341115 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 500/989] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:43:39 2022] DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments/12d59bee-a7d8-4409-b835-c70cf0c64e96 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:43:39.349719 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:39.350635 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:39.356714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:39.357170 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.357986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:39.358955 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.388767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-52f36b2a-3994-4c0b-9f05-5efaddf51b6c tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Feb 16 05:43:39.389360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 490/990] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:43:39 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:43:39.893192 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-b40cfb2e-1a6b-4776-b655-ca65f5b707be req-803652c7-e369-4edb-8ce1-af501d99658a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:39.895463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:39.895463 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:43:39.903019 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-b40cfb2e-1a6b-4776-b655-ca65f5b707be req-803652c7-e369-4edb-8ce1-af501d99658a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:39.903466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-b40cfb2e-1a6b-4776-b655-ca65f5b707be req-803652c7-e369-4edb-8ce1-af501d99658a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:39.915508 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-b40cfb2e-1a6b-4776-b655-ca65f5b707be req-803652c7-e369-4edb-8ce1-af501d99658a service nova] Creating event network-changed:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:43:39.920323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-b40cfb2e-1a6b-4776-b655-ca65f5b707be req-803652c7-e369-4edb-8ce1-af501d99658a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032408 Feb 16 05:43:39.920975 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 501/991] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:43:40.057074 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:40.057882 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:40.066726 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.067184 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.067979 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.068422 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.218867 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:40.226767 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a9afea12-8248-468b-b7db-21c549d55689 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.173454 Feb 16 05:43:40.227346 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 491/992] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:40 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:40.401251 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:40.402268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:40.408827 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.409299 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.410287 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.410728 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.438878 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6f2a1b93-b663-4e44-9412-088bc38b84b3 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042241 Feb 16 05:43:40.439441 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 502/993] 10.222.0.75 () {58 vars in 1301 bytes} [Wed Feb 16 05:43:40 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 05:43:40.449542 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:40.450727 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:40.457066 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.457556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.458343 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:40.458794 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:40.530705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] HTTP exception thrown: Instance 406bec91-5d24-4662-8c2b-202a785d249f is not attached to volume 12d59bee-a7d8-4409-b835-c70cf0c64e96 Feb 16 05:43:40.531317 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Returning 404 to user: Instance 406bec91-5d24-4662-8c2b-202a785d249f is not attached to volume 12d59bee-a7d8-4409-b835-c70cf0c64e96 {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:43:40.532153 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-a260030e-f922-43d5-bd01-69be74c4c79d tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments/12d59bee-a7d8-4409-b835-c70cf0c64e96" status: 404 len: 154 microversion: 2.1 time: 0.086654 Feb 16 05:43:40.532705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 492/994] 10.222.0.75 () {58 vars in 1415 bytes} [Wed Feb 16 05:43:40 2022] DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f/os-volume_attachments/12d59bee-a7d8-4409-b835-c70cf0c64e96 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:43:41.245307 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:41.245829 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:41.251670 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.252114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.252884 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.253347 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.387590 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:41.395487 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-901aceac-d363-4ff5-b15e-e4ac692a08aa tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.154049 Feb 16 05:43:41.396061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 503/995] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:41 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:41.659151 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:41.659650 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:41.666140 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.666598 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.667391 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.667833 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.692131 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:43:41.769208 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e739918d-5d14-4dd7-9abe-29c86e320407 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 204 len: 0 microversion: 2.1 time: 0.113369 Feb 16 05:43:41.770009 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 493/996] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:43:41 2022] DELETE /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:43:41.777848 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:41.778459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:41.784928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.785410 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.786486 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:41.786923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:41.920858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:41.928116 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7531ebfd-2b91-474e-a820-4d5a425b7f16 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1556 microversion: 2.1 time: 0.153920 Feb 16 05:43:41.928687 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 504/997] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:41 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:42.412394 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:42.413086 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:42.419064 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:42.419515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:42.420286 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:42.420731 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:42.561935 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:42.569120 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-497b75ca-840d-438e-b816-479e2061dd71 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.161052 Feb 16 05:43:42.569713 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 494/998] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:42 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:42.944742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:42.945473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:42.952252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:42.952777 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:42.953668 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:42.954286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:43.073066 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-ee312d5c-438f-4f68-bf04-5438ec2d8c27 req-a9666c5b-ce4e-4b1b-926a-add45b9fb4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97656735-cb10-4bd1-b2dd-8ed733784a21", "name": "network-vif-plugged", "status": "completed", "tag": "904032fd-091e-48cf-b168-d47fb2b17635"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:43.074746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:43.074746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:43:43.082301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-ee312d5c-438f-4f68-bf04-5438ec2d8c27 req-a9666c5b-ce4e-4b1b-926a-add45b9fb4ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:43.083049 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-ee312d5c-438f-4f68-bf04-5438ec2d8c27 req-a9666c5b-ce4e-4b1b-926a-add45b9fb4ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:43.095231 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-ee312d5c-438f-4f68-bf04-5438ec2d8c27 req-a9666c5b-ce4e-4b1b-926a-add45b9fb4ce service nova] Creating event network-vif-plugged:904032fd-091e-48cf-b168-d47fb2b17635 for instance 97656735-cb10-4bd1-b2dd-8ed733784a21 on hv-cinder-82947 Feb 16 05:43:43.100844 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-ee312d5c-438f-4f68-bf04-5438ec2d8c27 req-a9666c5b-ce4e-4b1b-926a-add45b9fb4ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118119 Feb 16 05:43:43.101688 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 495/999] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:43:43.103825 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:43.112990 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-bba57458-c7bf-4a13-a0dc-caa16feaf793 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1556 microversion: 2.1 time: 0.171897 Feb 16 05:43:43.113744 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 505/1000] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:42 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:43.586204 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:43.586912 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:43.593499 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:43.593953 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:43.594735 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:43.595174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:43.726705 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:43.734166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0a374913-d3f8-41e9-908e-b010a825f999 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1267 microversion: 2.1 time: 0.151953 Feb 16 05:43:43.734781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 496/1001] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:43 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:44.130544 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:44.131150 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:44.137279 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.137723 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.138490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.138923 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.380800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584d2cb873f74a1094a192f8de8f0451', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba122c4197da463faf4c622f2ba7087c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:44.387936 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f31f0013-21d9-45e9-b912-1a7fb71b46cd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 200 len: 1556 microversion: 2.1 time: 0.261030 Feb 16 05:43:44.388500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 506/1002] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:44 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:44.414384 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-620b8825-5091-45d5-8958-d6f79c7fe9b8 req-5aca1713-9ecc-4e9b-9363-ff0aa975189f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406bec91-5d24-4662-8c2b-202a785d249f", "name": "network-vif-deleted", "tag": "d9cb8c4a-31d8-4400-b6a4-be7266eef1d1"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:44.416029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:44.416029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:43:44.423579 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-620b8825-5091-45d5-8958-d6f79c7fe9b8 req-5aca1713-9ecc-4e9b-9363-ff0aa975189f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.424032 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-620b8825-5091-45d5-8958-d6f79c7fe9b8 req-5aca1713-9ecc-4e9b-9363-ff0aa975189f service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.435646 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-620b8825-5091-45d5-8958-d6f79c7fe9b8 req-5aca1713-9ecc-4e9b-9363-ff0aa975189f service nova] Creating event network-vif-deleted:d9cb8c4a-31d8-4400-b6a4-be7266eef1d1 for instance 406bec91-5d24-4662-8c2b-202a785d249f on hv-cinder-82947 Feb 16 05:43:44.441142 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-620b8825-5091-45d5-8958-d6f79c7fe9b8 req-5aca1713-9ecc-4e9b-9363-ff0aa975189f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 Feb 16 05:43:44.441759 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 497/1003] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:43:44.751409 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:44.752029 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:44.758191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.758643 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.759439 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.759879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.911897 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:44.919471 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c70120f9-ed29-444a-896d-eef914e99a53 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1453 microversion: 2.1 time: 0.172247 Feb 16 05:43:44.920032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 507/1004] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:44 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:43:44.936148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:44.936744 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:44.942842 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.943309 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:44.944096 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:44.944678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:45.082672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:43:45.089996 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-492bf81b-c792-410c-965e-b8a457b52a77 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1453 microversion: 2.1 time: 0.157938 Feb 16 05:43:45.090561 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 498/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:44 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:43:45.405982 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:45.406620 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] [instance: 406bec91-5d24-4662-8c2b-202a785d249f] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:43:45.413161 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:45.413636 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:45.414408 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:45.414839 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:45.428947 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] HTTP exception thrown: Instance 406bec91-5d24-4662-8c2b-202a785d249f could not be found. Feb 16 05:43:45.429575 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Returning 404 to user: Instance 406bec91-5d24-4662-8c2b-202a785d249f could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:43:45.430406 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e2144fd9-2e8c-47ec-94e3-32ee89513abd tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f" status: 404 len: 111 microversion: 2.1 time: 0.028800 Feb 16 05:43:45.430959 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 508/1006] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:43:45 2022] GET /compute/v2.1/servers/406bec91-5d24-4662-8c2b-202a785d249f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:43:45.438880 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d6ae5117-fef0-4beb-a4d0-6e35edd0bd51 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] Calling method '.version_select at 0x7fc591526040>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:43:45.456617 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d6ae5117-fef0-4beb-a4d0-6e35edd0bd51 tempest-TestMinimumBasicScenario-85002643 tempest-TestMinimumBasicScenario-85002643-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333849192" status: 202 len: 0 microversion: 2.1 time: 0.021265 Feb 16 05:43:45.457192 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 499/1007] 10.222.0.75 () {58 vars in 1271 bytes} [Wed Feb 16 05:43:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333849192 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:43:46.994195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-e4329566-0ca9-418f-aa56-7703cd4c9607 req-b4c4cec7-d955-4f98-8036-ffe59609db46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97656735-cb10-4bd1-b2dd-8ed733784a21", "tag": "904032fd-091e-48cf-b168-d47fb2b17635"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:43:46.996529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:43:46.996529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:43:47.007381 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-e4329566-0ca9-418f-aa56-7703cd4c9607 req-b4c4cec7-d955-4f98-8036-ffe59609db46 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:43:47.008176 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-e4329566-0ca9-418f-aa56-7703cd4c9607 req-b4c4cec7-d955-4f98-8036-ffe59609db46 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:43:47.024160 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-e4329566-0ca9-418f-aa56-7703cd4c9607 req-b4c4cec7-d955-4f98-8036-ffe59609db46 service nova] Creating event network-changed:904032fd-091e-48cf-b168-d47fb2b17635 for instance 97656735-cb10-4bd1-b2dd-8ed733784a21 on hv-cinder-82947 Feb 16 05:43:47.033147 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-e4329566-0ca9-418f-aa56-7703cd4c9607 req-b4c4cec7-d955-4f98-8036-ffe59609db46 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045594 Feb 16 05:43:47.034570 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 509/1008] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:44:03.114555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Action: 'create', calling method: .version_select at 0x7fc59160d9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1138371239"}} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:44:03.128439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:44:03.132247 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for user 966870646c4241a2a1de22777b413f59 and project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:44:03.313557 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:44:03.317314 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.quota [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for user 966870646c4241a2a1de22777b413f59 and project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'key_pairs'} {{(pid=122879) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:44:03.330588 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-20c74a88-0bcc-4f4a-b619-bc45bc5063c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.433444 Feb 16 05:44:03.331385 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 500/1009] 10.222.0.75 () {60 vars in 1157 bytes} [Wed Feb 16 05:44:02 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:19.363360 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-580464016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1138371239", "security_groups": [{"name": "tempest-secgroup-smoke-367204395"}], "networks": [{"uuid": "08c93e3a-350f-4d6d-880f-bc031b7d1c19"}], "block_device_mapping_v2": [{"uuid": "4f969a8f-8a85-44e6-b1a5-16a99cbc8c0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:44:19.471523 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.network.neutron [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] validate_networks() for [('08c93e3a-350f-4d6d-880f-bc031b7d1c19', None, None, None, None, None)] {{(pid=122878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 05:44:20.180265 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Flavor limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 05:44:20.180693 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Image limits 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 05:44:20.181169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Flavor pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 05:44:20.181616 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Image pref 0:0:0 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 05:44:20.182060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.virt.hardware [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 05:44:20.191216 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:20.191667 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:20.192525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:20.192963 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:20.208802 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 05:44:20.212730 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.quota [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Getting quotas for user 966870646c4241a2a1de22777b413f59 and project 563c1c32061d4b78be6a20b84fd3ae39. Resources: {'ram', 'cores', 'instances'} {{(pid=122878) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 05:44:20.266685 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Going to run 1 instances... {{(pid=122878) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 05:44:20.268858 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f969a8f-8a85-44e6-b1a5-16a99cbc8c0c',volume_size=None,volume_type=None)] {{(pid=122878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 05:44:20.387375 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [ea76b5df-b7fa-459c-b29d-6a4201e31eb0] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 16 05:44:21.394302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [ea76b5df-b7fa-459c-b29d-6a4201e31eb0] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 33350. Feb 16 05:44:21.398586 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-0e6a4be9-7465-44c9-b382-134e4ff8005f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.039840 Feb 16 05:44:21.399226 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 510/1010] 10.222.0.75 () {60 vars in 1146 bytes} [Wed Feb 16 05:44:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 16 05:44:21.410127 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-71622124-2ee8-450a-8078-77c4fc5120fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:21.410738 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-71622124-2ee8-450a-8078-77c4fc5120fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:21.461771 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-71622124-2ee8-450a-8078-77c4fc5120fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:21.468694 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-71622124-2ee8-450a-8078-77c4fc5120fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1088 microversion: 2.1 time: 0.062816 Feb 16 05:44:21.469251 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 501/1011] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:21 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1088 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:22.485673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-e6b87547-c19c-4278-8398-498c5fcca60b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:22.486291 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-e6b87547-c19c-4278-8398-498c5fcca60b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:22.542906 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-e6b87547-c19c-4278-8398-498c5fcca60b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:22.549593 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-e6b87547-c19c-4278-8398-498c5fcca60b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1088 microversion: 2.1 time: 0.068041 Feb 16 05:44:22.550159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 511/1012] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:22 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:23.566537 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-dbffaf93-458d-471e-a0d6-005f41f0f8ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:23.567250 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-dbffaf93-458d-471e-a0d6-005f41f0f8ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:23.620599 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-dbffaf93-458d-471e-a0d6-005f41f0f8ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:23.627667 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-dbffaf93-458d-471e-a0d6-005f41f0f8ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1088 microversion: 2.1 time: 0.065020 Feb 16 05:44:23.628224 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 502/1013] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:23 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:24.644269 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-96f82645-19dd-44d0-bda7-bb889bb2c5e5 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:24.644879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-96f82645-19dd-44d0-bda7-bb889bb2c5e5 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:24.698838 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-96f82645-19dd-44d0-bda7-bb889bb2c5e5 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:24.705944 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-96f82645-19dd-44d0-bda7-bb889bb2c5e5 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1088 microversion: 2.1 time: 0.065341 Feb 16 05:44:24.706516 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 512/1014] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:24 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:25.722156 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:25.722769 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:25.729190 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:25.729681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:25.730453 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:25.730888 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:25.791027 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:25.798594 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d3c63160-d016-4338-bafa-42210fdaddc2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1138 microversion: 2.1 time: 0.080111 Feb 16 05:44:25.799166 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 503/1015] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:25 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:44:26.816421 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:26.817083 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:26.823961 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:26.824410 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:26.825552 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:26.825988 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:26.900379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:26.908985 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b7be0f55-f83a-4d9b-ad12-ee098e6ff8c7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1204 microversion: 2.1 time: 0.097530 Feb 16 05:44:26.909598 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 513/1016] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:26 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:27.822887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-2c202db4-abdb-4992-b9f0-1856088da0a6 req-5a7c0ce0-231e-4672-9208-996d9e7c63e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:44:27.825129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:44:27.825129 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:44:27.834258 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-2c202db4-abdb-4992-b9f0-1856088da0a6 req-5a7c0ce0-231e-4672-9208-996d9e7c63e8 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:27.835135 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-2c202db4-abdb-4992-b9f0-1856088da0a6 req-5a7c0ce0-231e-4672-9208-996d9e7c63e8 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:27.847952 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-2c202db4-abdb-4992-b9f0-1856088da0a6 req-5a7c0ce0-231e-4672-9208-996d9e7c63e8 service nova] Creating event network-changed:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:44:27.852761 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-2c202db4-abdb-4992-b9f0-1856088da0a6 req-5a7c0ce0-231e-4672-9208-996d9e7c63e8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033798 Feb 16 05:44:27.853752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 504/1017] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:44:27.925877 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:27.927298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:27.933867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:27.934379 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:27.935211 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:27.935639 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:28.160016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:28.167597 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b875499b-fe80-4c81-890c-4eb9103841ec tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.245382 Feb 16 05:44:28.168171 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 514/1018] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:27 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:29.186065 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:29.186671 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:29.192752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:29.193213 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:29.194019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:29.194458 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:29.330490 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:29.337689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-d3d5be64-3563-4aca-b877-e79afa489ae8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.156205 Feb 16 05:44:29.338260 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 505/1019] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:29 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:30.354529 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:30.355151 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:30.361500 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:30.361957 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:30.362737 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:30.363177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:30.500074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:30.507342 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-2f035c75-d73e-47be-8282-c67ce76a265f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.156487 Feb 16 05:44:30.507913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 515/1020] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:30 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:31.523818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:31.524434 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:31.531352 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:31.531806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:31.532592 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:31.533029 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:31.662774 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:31.670124 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-ec055327-9a73-44f2-bca3-cc71f1ad831b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.149933 Feb 16 05:44:31.670696 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 506/1021] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:31 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:32.687722 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:32.687722 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:32.697803 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:32.698252 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:32.699032 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:32.699466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:32.834780 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:32.843628 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-efb89233-d811-491c-bdd7-3990e8bfbb81 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.161079 Feb 16 05:44:32.844207 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 516/1022] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:32 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:33.860451 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:33.861063 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:33.868093 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:33.868433 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:33.869220 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:33.869695 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:34.013809 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:34.021021 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-41ffa997-67e1-4fec-a265-4305738dd1b2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.164905 Feb 16 05:44:34.021618 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 507/1023] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:33 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:35.039346 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:35.039971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:35.047061 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:35.047515 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:35.048305 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:35.048746 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:35.189533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:35.197000 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-5f7eb2fa-f5b6-4421-a710-d566d3873e31 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.162879 Feb 16 05:44:35.200502 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 517/1024] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:35 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:36.213381 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:36.213991 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:36.220826 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:36.221284 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:36.222056 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:36.222482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:36.353375 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:36.361246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-f5af5ccf-17b7-442d-adaf-ba51be23cfc8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.151668 Feb 16 05:44:36.361837 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 508/1025] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:36 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:37.377714 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:37.378259 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:37.384609 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:37.385063 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:37.385867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:37.386308 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:37.518867 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:37.526194 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-22b8fffb-8251-4933-9d80-51cb5143790f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.152181 Feb 16 05:44:37.526766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 518/1026] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:37 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:38.542928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:38.543592 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:38.550421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:38.550872 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:38.551652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:38.552090 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:38.681608 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:38.689421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4273c451-4359-4e9e-973e-3955dfc0b3c4 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.150160 Feb 16 05:44:38.689986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 509/1027] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:38 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:39.211138 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-0c94b75a-aa7e-4c0c-b6d4-41a58ce4ed2a req-a4999eda-6356-4831-9c39-05a6ce6988ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "name": "network-vif-plugged", "status": "completed", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:44:39.213074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:44:39.213074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:44:39.220444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-0c94b75a-aa7e-4c0c-b6d4-41a58ce4ed2a req-a4999eda-6356-4831-9c39-05a6ce6988ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:39.220980 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-0c94b75a-aa7e-4c0c-b6d4-41a58ce4ed2a req-a4999eda-6356-4831-9c39-05a6ce6988ce service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:39.233699 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-0c94b75a-aa7e-4c0c-b6d4-41a58ce4ed2a req-a4999eda-6356-4831-9c39-05a6ce6988ce service nova] Creating event network-vif-plugged:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:44:39.238873 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-0c94b75a-aa7e-4c0c-b6d4-41a58ce4ed2a req-a4999eda-6356-4831-9c39-05a6ce6988ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Feb 16 05:44:39.239473 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 519/1028] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:44:39.705589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:39.706198 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:39.712458 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:39.712907 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:39.713707 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:39.714144 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:39.850589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:39.857838 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-0fdb338c-725d-4eaa-a40e-8bd4d85bf065 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1259 microversion: 2.1 time: 0.155945 Feb 16 05:44:39.858397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 510/1029] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:39 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:40.875435 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:40.876302 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:40.882856 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:40.883311 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:40.884092 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:40.884533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:41.016459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:41.023720 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b23d17e3-0abc-407b-a280-04416e1f0a4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1443 microversion: 2.1 time: 0.152945 Feb 16 05:44:41.024298 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 520/1030] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:40 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:41.039963 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:44:41.040613 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:44:41.046961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:41.047408 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:41.048181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:41.048614 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:41.179851 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:44:41.187123 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-33a05adb-278e-45ff-8b3a-4aa85b5f9591 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1443 microversion: 2.1 time: 0.151030 Feb 16 05:44:41.187684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 511/1031] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:44:41 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:44:42.801323 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-9af264f0-68f7-43c8-b444-ccb919dfaf89 req-46cc2b5a-441c-4c5e-a925-5a115d9cc307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:44:42.802904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:44:42.802904 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:44:42.810355 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9af264f0-68f7-43c8-b444-ccb919dfaf89 req-46cc2b5a-441c-4c5e-a925-5a115d9cc307 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:44:42.810816 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-9af264f0-68f7-43c8-b444-ccb919dfaf89 req-46cc2b5a-441c-4c5e-a925-5a115d9cc307 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:44:42.822278 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-9af264f0-68f7-43c8-b444-ccb919dfaf89 req-46cc2b5a-441c-4c5e-a925-5a115d9cc307 service nova] Creating event network-changed:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:44:42.827292 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-9af264f0-68f7-43c8-b444-ccb919dfaf89 req-46cc2b5a-441c-4c5e-a925-5a115d9cc307 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029626 Feb 16 05:44:42.827899 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 521/1032] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:45:01.834159 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:45:01.834782 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:45:16.847764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:16.848439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:16.854956 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:16.855437 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:16.856246 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:16.856684 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:16.884672 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:45:16.917642 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-af68cc21-9919-43a2-9f63-7bf981b1eca8 req-3c581990-62cc-4597-9859-b3996755180a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97656735-cb10-4bd1-b2dd-8ed733784a21", "tag": "904032fd-091e-48cf-b168-d47fb2b17635"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:45:16.919153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:45:16.919153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:45:16.928183 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-af68cc21-9919-43a2-9f63-7bf981b1eca8 req-3c581990-62cc-4597-9859-b3996755180a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:16.928579 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-af68cc21-9919-43a2-9f63-7bf981b1eca8 req-3c581990-62cc-4597-9859-b3996755180a service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:16.939971 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-af68cc21-9919-43a2-9f63-7bf981b1eca8 req-3c581990-62cc-4597-9859-b3996755180a service nova] Creating event network-changed:904032fd-091e-48cf-b168-d47fb2b17635 for instance 97656735-cb10-4bd1-b2dd-8ed733784a21 on hv-cinder-82947 Feb 16 05:45:16.945680 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-af68cc21-9919-43a2-9f63-7bf981b1eca8 req-3c581990-62cc-4597-9859-b3996755180a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105244 Feb 16 05:45:16.946366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 522/1033] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:45:16.970392 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e6f98ad3-93ab-4be4-b01d-24485b6fa955 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "DELETE /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 204 len: 0 microversion: 2.1 time: 0.132469 Feb 16 05:45:16.970988 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 512/1034] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:45:16 2022] DELETE /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:45:16.979652 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:16.980571 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:17.002177 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:17.002761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:17.004051 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:17.004596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:17.550519 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:17.558627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1190ceea-e176-4131-ba59-05edeb0e3901 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1577 microversion: 2.1 time: 0.582967 Feb 16 05:45:17.559214 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 523/1035] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:16 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1577 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:45:18.577402 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:18.578101 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:18.584327 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:18.584781 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:18.585597 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:18.586035 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:18.728407 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:18.735798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-7c77da08-ba50-4279-9562-214ffe4b3f99 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1459 microversion: 2.1 time: 0.163132 Feb 16 05:45:18.736370 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 513/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:18 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:45:19.394334 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-11afd809-5e2f-421a-b282-1b50454d3130 req-e9d858db-2805-458d-8594-ddb0760a6f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97656735-cb10-4bd1-b2dd-8ed733784a21", "name": "network-vif-deleted", "tag": "904032fd-091e-48cf-b168-d47fb2b17635"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:45:19.396137 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:45:19.396137 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:45:19.403538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-11afd809-5e2f-421a-b282-1b50454d3130 req-e9d858db-2805-458d-8594-ddb0760a6f06 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:19.404621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-11afd809-5e2f-421a-b282-1b50454d3130 req-e9d858db-2805-458d-8594-ddb0760a6f06 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:19.415510 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-11afd809-5e2f-421a-b282-1b50454d3130 req-e9d858db-2805-458d-8594-ddb0760a6f06 service nova] Creating event network-vif-deleted:904032fd-091e-48cf-b168-d47fb2b17635 for instance 97656735-cb10-4bd1-b2dd-8ed733784a21 on hv-cinder-82947 Feb 16 05:45:19.420112 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-11afd809-5e2f-421a-b282-1b50454d3130 req-e9d858db-2805-458d-8594-ddb0760a6f06 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029365 Feb 16 05:45:19.420699 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 524/1037] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:45:19.755105 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:19.755772 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:19.762668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:19.763181 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:19.764628 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:19.765100 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:19.797003 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:19.797580 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:19.798108 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.objects.instance [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lazy-loading 'fault' on Instance uuid 97656735-cb10-4bd1-b2dd-8ed733784a21 {{(pid=122879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:45:19.839868 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:19.847788 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-c31282f6-647d-4277-b8ab-0eeec8152e18 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 200 len: 1231 microversion: 2.1 time: 0.096973 Feb 16 05:45:19.848439 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 514/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:19 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:45:20.866766 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:20.867445 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 97656735-cb10-4bd1-b2dd-8ed733784a21] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:20.873695 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:20.874141 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:20.874903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:20.875342 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:20.887868 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] HTTP exception thrown: Instance 97656735-cb10-4bd1-b2dd-8ed733784a21 could not be found. Feb 16 05:45:20.889072 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Returning 404 to user: Instance 97656735-cb10-4bd1-b2dd-8ed733784a21 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:45:20.889941 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-7351a820-d1a9-4798-b288-fa1d94ec9882 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21" status: 404 len: 111 microversion: 2.1 time: 0.027660 Feb 16 05:45:20.890452 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 525/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:20 2022] GET /compute/v2.1/servers/97656735-cb10-4bd1-b2dd-8ed733784a21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:45:23.937722 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:23.938224 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:23.944335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:23.944798 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:23.945442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-502e0827-cde5-4375-81d7-c94f6b6433ee req-468ab8f4-77af-4377-a63b-da1d579de8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd96ae9-65c0-4ea7-a034-c783711160d9", "tag": "04216612-6a17-42d7-bf1b-e4c80f38b38d"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:45:23.945891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:23.946069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:23.947031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:45:23.947031 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:45:23.954595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-502e0827-cde5-4375-81d7-c94f6b6433ee req-468ab8f4-77af-4377-a63b-da1d579de8c9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:23.955037 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-502e0827-cde5-4375-81d7-c94f6b6433ee req-468ab8f4-77af-4377-a63b-da1d579de8c9 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:23.968016 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-502e0827-cde5-4375-81d7-c94f6b6433ee req-468ab8f4-77af-4377-a63b-da1d579de8c9 service nova] Creating event network-changed:04216612-6a17-42d7-bf1b-e4c80f38b38d for instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 on hv-cinder-82947 Feb 16 05:45:23.972967 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-502e0827-cde5-4375-81d7-c94f6b6433ee req-468ab8f4-77af-4377-a63b-da1d579de8c9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 Feb 16 05:45:23.973595 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 526/1040] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:45:23.974203 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Going to try to terminate instance {{(pid=122879) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:45:24.061054 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b04ead58-8dea-46a0-9fd8-7d65147c6352 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 204 len: 0 microversion: 2.1 time: 0.126272 Feb 16 05:45:24.065668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 515/1041] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:45:23 2022] DELETE /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:45:24.071190 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:24.072187 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:24.078958 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:24.079479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:24.080346 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:24.080846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:24.340416 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:24.348235 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-67c00a42-2345-4cbe-bbf4-ad9ff81eb372 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1577 microversion: 2.1 time: 0.280899 Feb 16 05:45:24.349035 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 527/1042] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:24 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1577 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:45:25.366045 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:25.366777 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:25.373689 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:25.374148 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:25.374932 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:25.375372 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:25.505505 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:25.512733 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-cfbde640-2319-4bf1-a659-59563aeeaab7 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1458 microversion: 2.1 time: 0.150789 Feb 16 05:45:25.513315 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 516/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:25 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:45:26.232801 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [req-d2771f92-d9b3-4e4e-b126-5a80e435a902 req-a581921a-84bc-4a63-a957-bed261f38729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd96ae9-65c0-4ea7-a034-c783711160d9", "name": "network-vif-deleted", "tag": "04216612-6a17-42d7-bf1b-e4c80f38b38d"}]} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:45:26.234388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:45:26.234388 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: warnings.warn(msg) Feb 16 05:45:26.241673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d2771f92-d9b3-4e4e-b126-5a80e435a902 req-a581921a-84bc-4a63-a957-bed261f38729 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:26.242121 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [req-d2771f92-d9b3-4e4e-b126-5a80e435a902 req-a581921a-84bc-4a63-a957-bed261f38729 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:26.253692 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.compute.server_external_events [req-d2771f92-d9b3-4e4e-b126-5a80e435a902 req-a581921a-84bc-4a63-a957-bed261f38729 service nova] Creating event network-vif-deleted:04216612-6a17-42d7-bf1b-e4c80f38b38d for instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 on hv-cinder-82947 Feb 16 05:45:26.259114 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [req-d2771f92-d9b3-4e4e-b126-5a80e435a902 req-a581921a-84bc-4a63-a957-bed261f38729 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030140 Feb 16 05:45:26.260082 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 528/1044] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:45:26.529347 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:26.529964 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:26.537241 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:26.537734 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:26.538526 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:26.538962 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:26.610014 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87279464d1b74c0d88c95f4dec9871ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5222e96e134b27b8a588f1309a0097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:45:26.617712 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-205656c5-bc25-47de-a996-0e4b7d452487 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 200 len: 1225 microversion: 2.1 time: 0.091920 Feb 16 05:45:26.618346 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 517/1045] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:26 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:45:27.635806 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:27.636540 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 7fd96ae9-65c0-4ea7-a034-c783711160d9] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:27.643129 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:27.643583 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:27.644361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:27.644800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:27.658107 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] HTTP exception thrown: Instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 could not be found. Feb 16 05:45:27.658682 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Returning 404 to user: Instance 7fd96ae9-65c0-4ea7-a034-c783711160d9 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:45:27.659483 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-27e0041b-4c60-4973-91c3-3d5dbc67474d tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9" status: 404 len: 111 microversion: 2.1 time: 0.028226 Feb 16 05:45:27.660006 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 529/1046] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:27 2022] GET /compute/v2.1/servers/7fd96ae9-65c0-4ea7-a034-c783711160d9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:45:28.096995 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:28.097515 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:28.103644 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:28.104079 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:28.104849 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:28.105294 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:28.120475 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] HTTP exception thrown: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. Feb 16 05:45:28.121043 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Returning 404 to user: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:45:28.121871 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-3a998944-3101-4515-902d-5189f98446b9 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 404 len: 111 microversion: 2.1 time: 0.028703 Feb 16 05:45:28.122421 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 518/1047] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:45:28 2022] DELETE /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:45:28.130191 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:28.130800 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] [instance: 6a5c79d1-09d2-4e14-b144-40a132b546d6] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:45:28.136596 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:28.137048 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:28.137855 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:45:28.138324 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:45:28.151149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.wsgi [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] HTTP exception thrown: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. Feb 16 05:45:28.151673 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Returning 404 to user: Instance 6a5c79d1-09d2-4e14-b144-40a132b546d6 could not be found. {{(pid=122878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:45:28.152474 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-b1d84da7-0b3e-4056-9fca-faaadd110908 tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6" status: 404 len: 111 microversion: 2.1 time: 0.025961 Feb 16 05:45:28.152996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 530/1048] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:45:28 2022] GET /compute/v2.1/servers/6a5c79d1-09d2-4e14-b144-40a132b546d6 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:45:29.428091 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e60516e3-7f8d-4b9c-bb93-128dede7590a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] Calling method '.version_select at 0x7fc5916de550>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:45:29.445709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e60516e3-7f8d-4b9c-bb93-128dede7590a tempest-TestVolumeBootPattern-1133312047 tempest-TestVolumeBootPattern-1133312047-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1385593991" status: 202 len: 0 microversion: 2.1 time: 0.021321 Feb 16 05:45:29.446284 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 519/1049] 10.222.0.75 () {58 vars in 1262 bytes} [Wed Feb 16 05:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1385593991 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:46:25.757555 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:46:25.758299 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:46:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:46:37.938761 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:46:37.939290 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:37.945197 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:37.945672 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:37.946442 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:37.946876 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:37.969195 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.objects.instance [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lazy-loading 'flavor' on Instance uuid a208c9c0-83b3-4543-9842-48a9183519da {{(pid=122878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 05:46:38.037492 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-c327c5af-c5de-43ec-8b19-092f5795968b tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "POST /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da/action" status: 202 len: 0 microversion: 2.1 time: 0.103691 Feb 16 05:46:38.038153 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 531/1050] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:46:37 2022] POST /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:46:38.048568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:38.049180 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:38.056678 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:38.057189 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:38.058591 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:38.059036 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:38.196138 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:38.203470 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-83a4dc9e-4bdc-4eb6-a653-34391132c6fc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.160555 Feb 16 05:46:38.204036 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 520/1051] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:38 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:46:39.221193 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:39.221913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:39.227955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:39.228399 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:39.229169 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:39.229631 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:39.365577 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:39.373536 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-776a3f1a-c225-4388-a63d-0e0698a92f66 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.156845 Feb 16 05:46:39.374106 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 532/1052] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:39 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:40.390887 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:40.391566 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:40.397757 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:40.398224 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:40.398992 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:40.399416 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:40.529971 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:40.537489 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-bbf2e093-f19a-4c7c-a371-ac77d54b80e3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.150815 Feb 16 05:46:40.538053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 521/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:40 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:41.554268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:41.554929 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:41.561726 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:41.562180 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:41.562955 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:41.563396 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:41.697450 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:41.705275 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-1cca5054-24ef-4cf8-b8c9-2c073ae3b2d7 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.154671 Feb 16 05:46:41.705863 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 533/1054] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:41 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:42.722174 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:42.722780 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:42.729069 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:42.729556 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:42.730321 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:42.730752 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:42.863366 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:42.870664 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-845c0898-4f1b-43f1-86a6-4337480c0bf2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.152152 Feb 16 05:46:42.871229 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 522/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:42 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:43.887742 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:43.888383 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:43.894676 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:43.895136 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:43.895915 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:43.896356 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:44.028459 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:44.036627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dc8f876e-d9d8-43fb-9136-231ebfaada46 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.152588 Feb 16 05:46:44.037201 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 534/1056] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:43 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:45.053803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:45.054420 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:45.061354 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:45.061806 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:45.062577 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:45.063012 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:45.196548 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:45.203948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b6e096c9-5bb6-4dda-8439-2cea890003f2 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.153827 Feb 16 05:46:45.204523 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 523/1057] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:45 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:46.220621 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:46.221149 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:46.227427 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:46.227870 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:46.228633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:46.229060 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:46.363632 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:46.370968 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4acb6734-7908-4957-bbb0-a3594b0451ad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.154096 Feb 16 05:46:46.371533 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 535/1058] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:46 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:47.387940 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:47.389142 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:47.395521 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:47.395976 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:47.396764 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:47.397209 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:47.526482 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:47.533714 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-8d6d5171-08b6-4c2f-bc57-355ced72790e tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.149435 Feb 16 05:46:47.534304 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 524/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:47 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:48.551718 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:48.552436 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:48.558813 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:48.559268 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:48.560055 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:48.560530 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:48.759522 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:48.773097 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3ebd2c8e-804b-403e-99d8-552127f2877f tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.225045 Feb 16 05:46:48.773710 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 536/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:48 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:49.789865 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:49.790474 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:49.796775 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:49.797218 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:49.798053 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:49.798488 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:49.937742 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:49.945126 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-41414b68-29b8-4b37-8e64-aa6c599c7ea3 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.158905 Feb 16 05:46:49.945723 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 525/1061] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:49 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:50.961640 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:50.962247 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:50.968711 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:50.969167 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:50.970143 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:50.970582 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:51.108319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:51.115587 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ee857726-7a6f-4c84-98f0-d9bbe271c658 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1568 microversion: 2.1 time: 0.157713 Feb 16 05:46:51.116157 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 537/1062] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:50 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:51.131371 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:46:51.131948 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:51.138233 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:51.138681 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:51.139462 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:51.139901 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:51.225449 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-b5d45d4b-dc14-4a28-9756-7739faf93c7d tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "POST /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da/action" status: 202 len: 0 microversion: 2.1 time: 0.097616 Feb 16 05:46:51.225960 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 526/1063] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Feb 16 05:46:51 2022] POST /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:46:51.234842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:51.235451 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:51.241466 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:51.241920 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:51.242705 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:51.243142 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:51.405490 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:51.413108 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-ec1ec551-1402-48c5-adda-9b641fb2ccbc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1576 microversion: 2.1 time: 0.183010 Feb 16 05:46:51.413706 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 538/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:51 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 05:46:52.431335 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:52.431899 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:52.438573 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:52.439018 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:52.439849 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:52.440344 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:52.581922 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:52.589308 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-aa9aab25-ccd1-4747-ba47-872fb8724972 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1518 microversion: 2.1 time: 0.162291 Feb 16 05:46:52.589961 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 527/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:52 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:53.607300 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:53.607817 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:53.614189 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:53.614637 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:53.615413 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:53.615849 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:53.752047 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-4135656d-85c9-437f-ad20-0960c10d46c4 req-a12cd4ad-af8f-4493-936f-f3c93a819f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "name": "network-vif-unplugged", "status": "completed", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:46:53.753786 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:53.754729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:46:53.754729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:46:53.764818 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4a61d200-10f1-4f58-8258-cf142b35d410 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.160390 Feb 16 05:46:53.766034 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 539/1066] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:53 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:53.768927 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-4135656d-85c9-437f-ad20-0960c10d46c4 req-a12cd4ad-af8f-4493-936f-f3c93a819f97 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:53.769422 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-4135656d-85c9-437f-ad20-0960c10d46c4 req-a12cd4ad-af8f-4493-936f-f3c93a819f97 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:53.781682 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-4135656d-85c9-437f-ad20-0960c10d46c4 req-a12cd4ad-af8f-4493-936f-f3c93a819f97 service nova] Creating event network-vif-unplugged:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:46:53.786709 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-4135656d-85c9-437f-ad20-0960c10d46c4 req-a12cd4ad-af8f-4493-936f-f3c93a819f97 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039220 Feb 16 05:46:53.787306 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 528/1067] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:46:54.781663 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:54.782273 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:54.788879 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:54.789358 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:54.790132 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:54.790565 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:54.922292 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:54.929444 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-6533f1a4-373e-4be9-aead-ed659f41c1f0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.151423 Feb 16 05:46:54.930015 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 540/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:54 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:55.947033 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:55.947729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:55.954365 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:55.954810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:55.955589 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:55.956023 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:56.089841 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:56.097084 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-4270fa8d-feca-4c81-85bb-8b4913de4aa8 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.154584 Feb 16 05:46:56.097680 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 529/1069] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:55 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:57.114229 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:57.114842 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:57.121074 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:57.121538 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:57.122304 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:57.122731 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:57.251065 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:57.258361 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-3ea1c766-ee93-4ac8-8fb5-1f3064c61a68 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.147777 Feb 16 05:46:57.258932 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 541/1070] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:57 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:58.275019 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:58.275559 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:58.281779 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:58.282223 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:58.282986 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:58.283416 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:58.413216 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:58.421232 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-e5638c3c-9853-4208-82a4-db73a7c1c5e1 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.149265 Feb 16 05:46:58.421660 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 530/1071] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:58 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:46:59.437524 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:46:59.438144 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:46:59.444371 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:59.444821 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:59.445633 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:46:59.446075 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:46:59.585286 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:46:59.593319 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-4af03cc8-f835-48b7-9485-8cfbaf3918ca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.158866 Feb 16 05:46:59.593903 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 542/1072] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:46:59 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:47:00.610042 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:47:00.610653 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:47:00.616827 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:47:00.617282 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:47:00.618061 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:47:00.618492 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:47:00.753185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:47:00.761106 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-2a758e76-74c2-4db8-9f3e-b9fcf1329fce tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1574 microversion: 2.1 time: 0.154794 Feb 16 05:47:00.761715 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 531/1073] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:47:00 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:47:01.777496 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:47:01.778241 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:47:01.785571 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:47:01.786044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:47:01.786996 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:47:01.787429 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:47:01.926432 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:47:01.933723 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-dc7e01e6-c209-4f5f-b045-105637c59cb0 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1561 microversion: 2.1 time: 0.159936 Feb 16 05:47:01.934366 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 543/1074] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:47:01 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:47:03.841150 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-7e6490af-062c-4226-a236-f1bb7f98172b req-c5eaec99-dc3d-439d-b00e-b643e02cad46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "name": "network-vif-plugged", "status": "completed", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:47:03.843268 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:47:03.843268 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:47:03.851139 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-7e6490af-062c-4226-a236-f1bb7f98172b req-c5eaec99-dc3d-439d-b00e-b643e02cad46 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:47:03.851610 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-7e6490af-062c-4226-a236-f1bb7f98172b req-c5eaec99-dc3d-439d-b00e-b643e02cad46 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:47:03.865284 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-7e6490af-062c-4226-a236-f1bb7f98172b req-c5eaec99-dc3d-439d-b00e-b643e02cad46 service nova] Creating event network-vif-plugged:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:47:03.870175 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-7e6490af-062c-4226-a236-f1bb7f98172b req-c5eaec99-dc3d-439d-b00e-b643e02cad46 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Feb 16 05:47:03.870765 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 532/1075] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:48:10.791011 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:48:10.791652 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:48:18.613419 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:18.614059 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:48:18.616729 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-aadc531c-c6cf-4961-8f24-781e37e51d2e req-4a62dfe7-d333-4e15-b204-436fdb6f767c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:48:18.618891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:48:18.618891 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:48:18.620704 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:18.621455 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:18.622362 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:18.622910 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:18.626984 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-aadc531c-c6cf-4961-8f24-781e37e51d2e req-4a62dfe7-d333-4e15-b204-436fdb6f767c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:18.627427 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-aadc531c-c6cf-4961-8f24-781e37e51d2e req-4a62dfe7-d333-4e15-b204-436fdb6f767c service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:18.639301 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-aadc531c-c6cf-4961-8f24-781e37e51d2e req-4a62dfe7-d333-4e15-b204-436fdb6f767c service nova] Creating event network-changed:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:48:18.645553 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-aadc531c-c6cf-4961-8f24-781e37e51d2e req-4a62dfe7-d333-4e15-b204-436fdb6f767c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 Feb 16 05:48:18.646158 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 533/1076] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 05:48:18.650989 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Going to try to terminate instance {{(pid=122878) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 05:48:18.737338 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-485a94b8-91eb-4c67-93b4-8dab10b0a581 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 204 len: 0 microversion: 2.1 time: 0.128575 Feb 16 05:48:18.738071 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 544/1077] 10.222.0.75 () {58 vars in 1238 bytes} [Wed Feb 16 05:48:18 2022] DELETE /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 05:48:18.750818 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:18.752655 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:48:18.760120 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:18.760668 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:18.761576 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:18.762105 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:18.919699 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.policy [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122879) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:48:18.927323 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-92dd0ffc-8ec4-4153-8f8b-0269d4eb6fad tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1567 microversion: 2.1 time: 0.184548 Feb 16 05:48:18.928116 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 534/1078] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:48:18 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:48:19.944605 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:19.945217 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:48:19.954272 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:19.955437 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:19.956750 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:19.957585 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:20.091630 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:48:20.099564 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-f644aef2-80cd-406e-9311-989d293a3dcc tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1449 microversion: 2.1 time: 0.159221 Feb 16 05:48:20.100135 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 545/1079] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:48:19 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:48:20.927024 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [req-cb244938-7b23-455d-8c6f-6e4568837d60 req-833e3a97-e23d-40f5-937e-e54051496512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a208c9c0-83b3-4543-9842-48a9183519da", "name": "network-vif-deleted", "tag": "2f6ebdf7-c0bf-444a-8110-01a275c1f156"}]} {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 05:48:20.928895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:48:20.928895 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: warnings.warn(msg) Feb 16 05:48:20.935909 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-cb244938-7b23-455d-8c6f-6e4568837d60 req-833e3a97-e23d-40f5-937e-e54051496512 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:20.936360 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [req-cb244938-7b23-455d-8c6f-6e4568837d60 req-833e3a97-e23d-40f5-937e-e54051496512 service nova] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:20.948194 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.compute.server_external_events [req-cb244938-7b23-455d-8c6f-6e4568837d60 req-833e3a97-e23d-40f5-937e-e54051496512 service nova] Creating event network-vif-deleted:2f6ebdf7-c0bf-444a-8110-01a275c1f156 for instance a208c9c0-83b3-4543-9842-48a9183519da on hv-cinder-82947 Feb 16 05:48:20.953619 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [req-cb244938-7b23-455d-8c6f-6e4568837d60 req-833e3a97-e23d-40f5-937e-e54051496512 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 Feb 16 05:48:20.954382 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 535/1080] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Feb 16 05:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 05:48:21.117479 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:21.118036 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.compute.api [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122878) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:48:21.124257 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:21.124711 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:21.125525 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:21.125964 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG oslo_concurrency.lockutils [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:21.183719 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.policy [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966870646c4241a2a1de22777b413f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563c1c32061d4b78be6a20b84fd3ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122878) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 05:48:21.190913 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-befe13dc-3369-42e3-bd9d-e1b4de5d3dca tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 200 len: 1219 microversion: 2.1 time: 0.077221 Feb 16 05:48:21.191495 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 546/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:48:21 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 05:48:21.842600 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:48:21.842846 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:48:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:48:22.207700 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '>' {{(pid=122879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:22.208398 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.compute.api [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] [instance: a208c9c0-83b3-4543-9842-48a9183519da] Fetching instance by UUID {{(pid=122879) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 05:48:22.214519 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:22.214971 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:22.215746 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 05:48:22.216185 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG oslo_concurrency.lockutils [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Lock "1b177d00-4ec8-4b1e-aaf9-b063453fd96c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 05:48:22.228928 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.wsgi [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] HTTP exception thrown: Instance a208c9c0-83b3-4543-9842-48a9183519da could not be found. Feb 16 05:48:22.229486 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: DEBUG nova.api.openstack.wsgi [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Returning 404 to user: Instance a208c9c0-83b3-4543-9842-48a9183519da could not be found. {{(pid=122879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 05:48:22.230291 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO nova.api.openstack.requestlog [None req-af0cb0b2-dd70-413a-8274-1aac99388f4c tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da" status: 404 len: 111 microversion: 2.1 time: 0.027209 Feb 16 05:48:22.230810 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: [pid: 122879|app: 0|req: 536/1082] 10.222.0.75 () {58 vars in 1235 bytes} [Wed Feb 16 05:48:22 2022] GET /compute/v2.1/servers/a208c9c0-83b3-4543-9842-48a9183519da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 05:48:22.388907 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: DEBUG nova.api.openstack.wsgi [None req-99241bfe-762a-4c86-9990-97c99f89ce07 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] Calling method '.version_select at 0x7fc591da09d0>' {{(pid=122878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 05:48:22.409162 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO nova.api.openstack.requestlog [None req-99241bfe-762a-4c86-9990-97c99f89ce07 tempest-TestShelveInstance-1132867123 tempest-TestShelveInstance-1132867123-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1138371239" status: 202 len: 0 microversion: 2.1 time: 0.023790 Feb 16 05:48:22.413756 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: [pid: 122878|app: 0|req: 547/1083] 10.222.0.75 () {58 vars in 1253 bytes} [Wed Feb 16 05:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1138371239 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 05:49:44.213928 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:49:44.214627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:49:45.766544 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:49:45.767034 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:51:30.800397 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:51:30.801056 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:51:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:51:41.850665 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:51:41.851224 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:51:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:53:04.223768 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:53:04.224564 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:53:05.774303 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:53:05.774803 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:53:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:53:28.446044 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:53:28.446627 dv-cinder-829473-2-iscsi devstack@n-api.service[122878]: Wed Feb 16 05:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 05:53:36.278568 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 05:53:36.279016 dv-cinder-829473-2-iscsi devstack@n-api.service[122879]: Wed Feb 16 05:53:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!